andyprough
It would be great if you could substantiate your statement by researching for verifiable sources backing up your statement?
Here’s the Wikipedia description of BigScience BLOOM:
>”The BigScience Large Open-science Open-access Multilingual Language Model (BLOOM) is an open-access large language model (LLM) released in 2022. It was created by a volunteer-driven research effort to provide a transparently-created alternative to proprietary AI models.” [Reference: Inside a radical new project to democratize AI A group of over 1,000 AI researchers has created a multilingual large language model bigger than GPT-3—and they’re giving it out for free. — MIT Technology Review, July 12, 2022, https://www.technologyreview.com/2022/07/12/1055817/inside-a-radical-new-project-to-democratize-ai/%5D
>”With 176 billion parameters, BLOOM is a transformer-based autoregressive model designed to generate text in 46 natural languages and 13 programming languages. The model is distributed under the project’s “Responsible AI License”.
Here’s some of the MIT Technology Review’s description of BLOOM:
>”Unlike other, more famous large language models such as OpenAI’s GPT-3 and Google’s LaMDA, BLOOM (which stands for BigScience Large Open-science Open-access Multilingual Language Model) is designed to be as transparent as possible, with researchers sharing details about the data it was trained on, the challenges in its development, and the way they evaluated its performance. OpenAI and Google have not shared their code or made their models available to the public, and external researchers have very little understanding of how these models are trained.
>”BLOOM was created over the last year by over 1,000 volunteer researchers in a project called BigScience, which was coordinated by AI startup Hugging Face using funding from the French government. It officially launched on July 12. The researchers hope developing an open-access LLM that performs as well as other leading models will lead to long-lasting changes in the culture of AI development and help democratize access to cutting-edge AI technology for researchers around the world.”
Several websites discuss how easy BLOOM is to use. Here’s the MIT Technology Review’s discussion of its ease of use:
>”The model’s ease of access is its biggest selling point. Now that it’s live, anyone can download it and tinker with it free of charge on Hugging Face’s website. Users can pick from a selection of languages and then type in requests for BLOOM to do tasks like writing recipes or poems, translating or summarizing texts, or writing programming code. AI developers can use the model as a foundation to build their own applications.”
I’ll probably try to set up an antiX vm in the next few days and see if I can get one of the more recent versions of the model, called BLOOMZ, to do some basic translating work. It looks like it all works with python, using just the “transformers” python library from the Hugging Face website. As long as the BLOOMZ download size isn’t in the terabytes to get it running locally, I should be able to give it a test.