Connect with us

Tech

Stanford researchers terminate ChatGPT-like OpenAI two months after launch

Published

2 years ago

on

Researchers of artificial intelligence (AI) from Stanford managed to develop their ChatGPT chatbot demo Alpaca in less than two months but terminated it citing “hosting costs and the inadequacies of content filters” in the large language model’s (LLM) behaviour.

The termination announcement was made less than a week after it was released, as per Stanford Daily.

The source code of the ChatGPT model of Stanford — developed for less than $600 — is available publicly.

According to researchers, their chatbot model had a similar performance to OpenAI’s ChatGPT 3.5.

Scientists in their announcement said that their chatbot Alpaca is only for academic research and not for general use in the near future.

Alpaca researcher Tatsunori Hashimoto of the Computer Science Department said: “We think the interesting work is in developing methods on top of Alpaca [since the dataset itself is just a combination of known ideas], so we don’t have current plans along the lines of making more datasets of the same kind or scaling up the model,”

Alpaca was developed on Meta AI’s LLaMA 7B model and generated training data with the method known as self-instruct.

Adjunct professor Douwe Kiela noted that “As soon as the LLaMA model came out, the race was on.”

Kiela who also worked as an AI researcher at Facebook said that “Somebody was going to be the first to instruction-finetune the model, and so the Alpaca team was the first … and that’s one of the reasons it kind of went viral.”

“It’s a really, really cool, simple idea, and they executed really well.”

Hashimoto said that the “LLaMA base model is trained to predict the next word on internet data and that instruction-finetuning modifies the model to prefer completions that follow instructions over those that do not.”

The source code of Alpaca is available on GitHub — a source code sharing platform — and was viewed 17,500 times. More than 2,400 people have used the code for their own model.

“I think much of the observed performance of Alpaca comes from LLaMA, and so the base language model is still a key bottleneck,” Hashimoto stated.

As the use of artificial intelligence systems has been increasing with every passing day, scientists and experts have been debating over the publishing of the source code, data used by companies and their methods to train their AI models and the overall transparency of the technology.

He was of the view that “I think one of the safest ways to move forward with this technology is to make sure that it is not in too few hands.”

“We need to have places like Stanford, doing cutting-edge research on these large language models in the open. So I thought it was very encouraging that Stanford is still actually one of the big players in this large language model space,” Kiela noted. 

Related Topics:
Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Latest News

Balochistani Graduates Selected for NUTECH Islamabad’s Mining Program

Published

6 days ago

on

By

For 18 graduates of the Reko Diq Mining Project, the National University of Technology, Islamabad, has started a training program. These graduates will complete an 18-month on-the-job training program at Barrick’s International Mining Sites after completing a two-month course at NUTECH.

The graduates will acquire proficiency in mining and associated technical domains during the training program. The chosen graduates will also get specific instruction on environmental protection, safety, exploration, and geology.

Along with the development of communication skills, the curriculum will also emphasise the most recent advancements in the mining industry. Barrick’s International Graduate Development Program for 2024 includes the Balochistani graduates.

Additionally, nine Baloch graduates were selected in 2023 and transported to Barrick’s facility in Argentina for on-the-job training.

Continue Reading

Latest News

WhatsApp will improve the updates tab by introducing new shortcuts and a revamped interface.

Published

7 days ago

on

By

WhatsApp is implementing a new upgrade to refine the Updates tab interface, hence boosting accessibility for status and channel updates.

WABetaInfo reports that the upgrade introduces expedited shortcuts that streamline the updating of statuses and channels. Users can now select and upload photos and videos directly from the interface, reducing the steps involved in choosing media from the gallery.

The Meta-owned messaging application has also revamped the button for generating text-based status updates and introduced a feature for recording and sharing voice status updates. This offers customers a more expedient method to disseminate text and speech updates without depending on the floating action button.

The revisions correspond with recent modifications to other tabs, ensuring a modernised interface that improves navigation and update creation. WhatsApp is modifying the floating action button to facilitate content sharing within channels.

When selecting the floating action button, users will see several options, including creating status updates, starting new channels, or sharing photos, videos, voice, and text in existing channels. This revamp integrates all content-generating options into a singular section.

The new shortcuts are anticipated to be accessible to a broader user base in the forthcoming weeks. Beta testers can currently access them in the latest WhatsApp beta for Android, version 2.24.26.13, available on the Google Play Store.

Continue Reading

Latest News

China and Pakistan Sign Memorandum of Understanding to Launch AI-Powered Agricultural Equipment

Published

1 week ago

on

By

Through Chinese expertise, the arrangement, which was made possible by the Special Investment Facilitation Council (SIFC), intends to increase Pakistan’s agricultural output.

The Punjab government and China’s “AI Force Tech” company have inked a memorandum of understanding (MoU) to introduce advanced agricultural machinery during Chief Minister Maryam Nawaz’s visit to China.

Through the use of advanced robotic technology, the MoU seeks to transform Pakistan’s agricultural industry, guarantee economic growth, and boost farmers’ wealth with China’s assistance.

Through the partnership, Pakistan would also have the chance to absorb knowledge about China’s sophisticated farming methods.

In the meantime, plans have been revealed by the Federal Minister of Planning to send 1,000 agricultural experts to China to study contemporary farming methods.

A Chinese business and the Punjab government previously inked an agreement to introduce cutting-edge cancer treatment technologies to Punjab.

Maryam Nawaz signed a Memorandum of Understanding (MoU) with Hygea Medical Technologies while she was in China in order to introduce cutting-edge cancer treatment equipment and techniques to Punjab.

This equipment will make it feasible to treat cancer without the need for chemotherapy or surgery.

Following a meeting with Hygea Medical Technologies President Dr. Luo Fuliang, Maryam Nawaz said the organization has promised expert assistance for the establishment of the Nawaz Sharif Cancer Hospital.

She went on to say that the hospital will work with China to treat cancer patients utilizing the newest equipment and techniques following the agreement.

Maryam Nawaz and a high-level delegation are present. From December 8 to December 15, the chief minister will go to Beijing, Shanghai, Shenzhen, and Guangzhou.

CM Maryam Nawaz is expected to attend a number of conferences, events, and meetings with the goal of enhancing bilateral relations and looking into potential joint ventures in the areas of infrastructure development, technology, agriculture, and governance.

Continue Reading

Trending