Connect with us
By 2026 we may run out of data to train By 2026 we may run out of data to train

News

By 2026, we may run out of data to train large AI language models

Published

on

Large language AI models are currently used by many companies. After all, with their help, neural networks learn to generate coherent text or even program code. These models are trained on data from Wikipedia, scientific papers, books, and so on. The trend in recent years has been to train models on more and more data in the hope that this will make them more accurate. However, a problem arose.

By 2026 we may run out of data to train

Reportedly, the data types commonly used for training language models could end around 2026. After all, researchers are creating more powerful models with more and more capabilities, and they need more and more texts.

Part of the problem stems from the fact that researchers prepare data for training language models and pre-filter it for quality. High-quality texts can be good articles, while low-quality texts can be posts on social networks or comments on websites. Although the boundary between these concepts is quite blurred.

1669376503 242 By 2026 we may run out of data to train

Researchers usually train models on high quality texts, which has yielded results in the GPT-3 system and similar ones. However, if the problem of lack of material arises in the coming years, then neural networks can be “fed” with lower quality texts.

However, not all experts agree with this. Percy Liang, a professor of computer science at Stanford University, said there was evidence that small models trained on high quality texts performed better than large models trained on low quality texts.

It is also possible to train models on the same texts several times. Now large language models are trained on the same data only once. At the same time, users themselves often take part in training neural networks. An example would be the recent Galactica.

Click to comment

Leave a Reply

Your email address will not be published.

News

The whole Xiaomi 13 series has IP68 protection. The official poster contains the release date

Published

on

The whole Xiaomi 13 series has IP68 protection The official

The well-known insider Ice Universe, who regularly shares exclusive information about the latest in the mobile industry, has published a new Xiaomi 13 poster containing valuable information.

First, it says that the smartphone will meet the degree of protection against dust and moisture IP68. Secondly, the poster confirms the earlier information that Xiaomi 13 will be presented on December 1 this year, that is, on Thursday.

The whole Xiaomi 13 series has IP68 protection.  The official poster contains the release date

All Mi 13 series supports IP68! I am very happy that Xiaomi is moving forward with the addition of wireless charging, IP68, great cameras and screens, modern design and a more user-friendly MIUI 14.

ice universe

A few hours earlier, Ice Universe published a new image of the flagship smartphone Xiaomi 13, which will receive a flat screen with a narrow frame around the entire perimeter. On the sides and top, the width of the frame will be 1.61 mm, and at the bottom of the screen it will have a width of 1.81 mm. In this case, the effective display area will be 93.3%.

Ice Universe was the first to accurately talk about the new trend of smartphones with waterfall screens, the notch in the iPhone X, the new design of the iPhone 14 and Samsung’s 200-megapixel image sensor. Recently, he was the first to accurately report that Redmi Note 12 Pro + will receive a 200-megapixel main camera. Exclusive information about new products is leaked to him by sources in the research and development department of the South Korean giant.

Continue Reading

News

The flagships Xiaomi 13 and Xiaomi 13 Pro were first shown on the official image a few days before the announcement

Published

on

The flagships Xiaomi 13 and Xiaomi 13 Pro were first

Insider Ben Geskin has published a poster that confirms the release date of the Xiaomi 13 line of smartphones and contains partial images of them. Xiaomi 13 is expected to get a flat screen, while Xiaomi 13 Pro will be equipped with a curved display.

This fully confirms the previous information about both smartphones, which will also receive a flat frame around the perimeter, like the iPhone smartphones in the last three generations. In this case, the body will be made of aluminum alloy.

The flagships Xiaomi 13 and Xiaomi 13 Pro were first shown on the official image a few days before the announcement

It is reported that Xiaomi 13 will receive a case with dimensions of 152.83 x 71.53 x 8.37 mm, that is, the width and thickness are slightly increased compared to Xiaomi 12. The battery capacity should also increase, possibly up to 4700 mAh. The smartphone will receive support for 120-watt charging.

In addition to Snapdragon 8 Gen 2, Xiaomi 13 is expected to feature a 6.2-inch 1.5K or 2K screen, a 50-megapixel Sony IMX8 series main camera, and an ultrasonic in-screen fingerprint scanner.

The flagships Xiaomi 13 and Xiaomi 13 Pro were first shown on the official image a few days before the announcement

The image shows the width of the border

Another poster confirmed that Xiaomi 13 and Xiaomi 13 Pro will meet the IP68 dust and water resistance rating.

Xiaomi 13 series and MIUI 14 skin will be presented on December 1st.

Continue Reading

News

9,500 pages without cartridge replacement. MFP Xiaomi Mijia All-In-One fell in price in China

Published

on

9500 pages without cartridge replacement MFP Xiaomi Mijia All In One fell

Introduced this spring, the Xiaomi Mijia All-In-One multifunctional device, which originally cost about $190 in China, has now dropped to $150.

Xiaomi Mijia All-In-One supports printing files directly via USB connection. The device also supports WeChat remote printing and Xiaomi’s own Carefree Connect standard. The printer can only be connected to each family member by one person through the direct sharing permission granted in the Mijia app between family members.

9,500 pages without cartridge replacement.  MFP Xiaomi Mijia All-In-One fell in price in China

The MFP comes with high quality ink with a four-color cartridge. The manufacturer claims that before replacing the cartridge, Xiaomi Mijia All-In-One will be able to print 9500 pages. The device received a simple cartridge replacement mechanism.

Xiaomi Mijia All-In-One supports copying and scanning in color and black and white. In addition, scanned files can also be saved and sent to a smartphone using the app.

Continue Reading

Most Popular