IBM Granite

Granite
Developer(s)	IBM Research^[1]
Initial release	November 7, 2023; 6 months ago (2023-11-07)
Platform	IBM Watsonx (initially) GitHub Hugging Face RHEL AI
Type	Multimodal Large language model Generative pre-trained transformer Foundation model
License	Proprietary Code models: Open Source (Apache 2.0)^[2]

Machine learning and data mining
Part of a series on
Paradigms Supervised learning Unsupervised learning Online learning Batch learning Meta-learning Semi-supervised learning Self-supervised learning Reinforcement learning Curriculum learning Rule-based learning Quantum machine learning
Problems Classification Generative modeling Regression Clustering Dimensionality reduction Density estimation Anomaly detection Data cleaning AutoML Association rules Semantic analysis Structured prediction Feature engineering Feature learning Learning to rank Grammar induction Ontology learning Multimodal learning
Supervised learning (classification • regression) Apprenticeship learning Decision trees Ensembles Bagging Boosting Random forest k-NN Linear regression Naive Bayes Artificial neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH CURE Hierarchical k-means Fuzzy Expectation–maximization (EM) DBSCAN OPTICS Mean shift
Dimensionality reduction Factor analysis CCA ICA LDA NMF PCA PGD t-SNE SDL
Structured prediction Graphical models Bayes net Conditional random field Hidden Markov
Anomaly detection RANSAC k-NN Local outlier factor Isolation forest
Artificial neural network Autoencoder Cognitive computing Deep learning DeepDream Feedforward neural network Recurrent neural network LSTM GRU ESN reservoir computing Restricted Boltzmann machine GAN Diffusion model SOM Convolutional neural network U-Net Transformer Vision Mamba Spiking neural network Memtransistor Electrochemical RAM (ECRAM)
Reinforcement learning Q-learning SARSA Temporal difference (TD) Multi-agent Self-play
Learning with humans Active learning Crowdsourcing Human-in-the-loop RLHF
Model diagnostics Coefficient of determination Confusion matrix Learning curve ROC curve
Mathematical foundations Kernel machines Bias–variance tradeoff Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory
Machine-learning venues ECML PKDD NeurIPS ICML ICLR IJCAI ML JMLR
Related articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline of machine learning
v t e

IBM Granite is a series of decoder-only foundation models created by IBM. It was announced on September 7, 2023,^[3]^[4] and an initial paper was published 4 days later.^[5] Initially intended for use in the IBM's cloud-based data and generative AI platform Watsonx along with other models,^[6] IBM opened the source code of some code models.^[7] Granite models are trained on datasets curated from Internet, academic publishings, code datasets, legal and finance documents.^[8]^[9]^[1]

YouTube Encyclopedic

1/1
Views:
796

Transcription

Foundation models

A foundation model is an AI model trained on broad data at scale such that it can be adapted to a wide range of downstream tasks.^[10]

Granite's first foundation models were Granite.13b.instruct and Granite.13b.chat. The "13b" in their name comes from 13 billion, the amount of parameters they have as models, lesser than most of the larger models of the time. Later models vary from 3 to 34 billion parameters.^[3]^[11]

On May 6, 2024, IBM released the source code of four variations of Granite Code Models under Apache 2, an open source permissive license that allows completely free use, modification and sharing of the software, and put them on Hugging Face for public use.^[12]^[13] According to IBM's own report, Granite 8b outperforms Llama 3 on several coding related tasks within similar range of parameters.^[14]^[15]

References

^ ^a ^b McDowell, Steve. "IBM's New Granite Foundation Models Enable Safe Enterprise AI". Forbes.
^ ibm-granite/granite-code-models, IBM Granite, 2024-05-08, retrieved 2024-05-08
^ ^a ^b Nirmal, Dinesh (September 7, 2023). "Building AI for business: IBM's Granite foundation models". IBM.
^ "IBM debuts Granite series of hardware-efficient language models". September 7, 2023.
^ "Granite Foundation Models" (PDF). IBM. 2023-11-30.
^ Fritts, Harold (2024-04-22). "IBM Adds Meta Llama 3 To watsonx, Expands AI Offerings". StorageReview.com. Retrieved 2024-05-08.
^ Jindal, Siddharth (2024-05-07). "IBM Releases Open-Source Granite Code Models, Outperforms Llama 3". Analytics India Magazine. Retrieved 2024-05-08.
^ Azhar, Ali (2024-04-08). "IBM Patents a Faster Method to Train LLMs for Enterprises". Datanami. Retrieved 2024-05-08.
^ Wiggers, Kyle (2023-09-07). "IBM rolls out new generative AI features and models". TechCrunch. Retrieved 2024-05-08.
^ "Introducing the Center for Research on Foundation Models (CRFM)". Stanford HAI. 18 August 2021.
^ Pawar, Sahil (2023-09-11). "IBM Introduces Granite Series LLM Models for Watsonx Platform". Analytics Drift. Retrieved 2024-05-09.
^ Nine, Adrianna (May 7, 2024). "IBM Makes Granite AI Models Open-Source Under New InstructLab Platform". ExtremeTech.
^ "IBM open-sources its Granite AI models - and they mean business". ZDNET. Retrieved 2024-05-21.
^ Jindal, Siddharth (2024-05-07). "IBM Releases Open-Source Granite Code Models, Outperforms Llama 3". Analytics India Magazine. Retrieved 2024-05-09.
^ Synced (2024-05-13). "IBM's Granite Code: Powering Enterprise Software Development with AI Precision | Synced". syncedreview.com. Retrieved 2024-05-21.

External links

IBM

History

Products

Hardware

Current	Mainframe IBM Z Power microprocessors Power Systems Storage FlashSystem DS8000 Quantum Q System One Q System Two Eagle Osprey Heron Condor
Former	Blue Gene Cell microprocessors PowerPC Midrange computer Personal Computer Selectric ThinkPad

Other

Business
entities

Current	Apptio Center for The Business of Government Consulting Promontory Kenexa International subsidiaries India Press Red Hat Research
Former	AdStar AIM alliance Kaleida Labs Taligent Ambra Computer Cognos EduQuest Kyndryl Lexmark Merative Microelectronics Product Center Science Research Associates Service Bureau The Weather Company (Weather Underground)

Facilities

Towers
- 1250 René-Lévesque, Montreal, QC
- One Atlantic Center, Atlanta, GA
Software Labs
- Rome Software Lab
- Toronto Software Lab
IBM Buildings
- 330 North Wabash, Chicago, IL
- Honolulu
- Seattle
Facilities
Cambridge Scientific Center
IBM Hursley
Canada Head Office Building
IBM Rochester

Initiatives

Inventions

Terminology

CEOs

Thomas J. Watson (1914–1956)
Thomas Watson Jr. (1956–1971)
T. Vincent Learson (1971–1973)
Frank T. Cary (1973–1981)
John R. Opel (1981–1985)
John Fellows Akers (1985–1993)
Louis V. Gerstner Jr. (1993–2002)
Samuel J. Palmisano (2002–2011)
Ginni Rometty (2012–2020)
Arvind Krishna (since 2020)

Board of
directors

Other

A Boy and His Atom
Big Blue sports teams
- American football
- Rugby union
Common Public License/IBM Public License
Deep Blue
Deep Thought
Dynamic infrastructure
GlobalFoundries
GUIDE International
IBM and the Holocaust
International chess tournament
Lucifer cipher
Mathematica
IBM Plex
SHARE computing
ScicomP
Unions

Differentiable computing

General

Concepts

Applications

Hardware

Software libraries

Implementations

Audio–visual	AlexNet WaveNet Human image synthesis HWR OCR Speech synthesis Speech recognition Facial recognition AlphaFold Text-to-image models DALL-E Midjourney Stable Diffusion Text-to-video models Sora VideoPoet Whisper
Verbal	Word2vec Seq2seq BERT Gemini LaMDA Bard NMT Project Debater IBM Watson IBM Watsonx Granite GPT-1 GPT-2 GPT-3 GPT-4 ChatGPT GPT-J Chinchilla AI PaLM BLOOM LLaMA PanGu-Σ
Decisional	AlphaGo AlphaZero Q-learning SARSA OpenAI Five Self-driving car MuZero Action selection Auto-GPT Robot control

People

Organizations

Architectures

Portals
- Computer programming
- Technology
Categories
- Artificial neural networks
- Machine learning

This page was last edited on 21 May 2024, at 11:22

From Wikipedia, the free encyclopedia

YouTube Encyclopedic

Transcription

Foundation models

See also

References

External links