3144 IBMs new AI supercomputer Blue Vela and how to use InstructLab on IBM Cloud.pdf

1、October 21-24,2024Mandalay Bay Convention CenterLas Vegas,NevadaSession 3144IBMs new AI supercomputer Blue Vela,IBMs new AI supercomputer Blue Vela,and how to use InstructLab on IBM Cloudand how to use InstructLab on IBM CloudFelix Eickhoff,Director,AI Infrastructure Program Management,IBMKyle Dufre

2、sne,Sr.Vice President,AI and Edge Solutions Sales,Dell TechnologiesDinakaran Joseph,Distinguished Engineer,IBM Cloud,IBMAgenda010203Granite ModelsIBM AI Training Infrastructure-Blue VelaInstructLab on IBM CloudIBM TechXchange|2024 IBM Corporation#IBMTechXchangeThe Granite Model Family3IBM TechXchang

3、e|2024 IBM CorporationLanguageCodeGranite-7b-instructEnglishGranite-13b-chatEnglishGranite-8b-japaneseJapaneseGranite-20b-multilingualFr,De,Es,PtGranite-3b-code-instructGranite-8b-code-instructGranite-20b-code-instructGranite-34b-code-instructOpenGraniteGranite is designed to support a broaderecosys

4、tem of open-source innovationEfficientGraniteGranite is targeted towards efficiententerprise applicationsTrustedGraniteGranite is built in a transparent mannerto support trusted deployments#IBMTechXchange#IBMTechXchangeThe Granite Model Family4IBM TechXchange|2024 IBM Corporation#IBMTechXchange#IBMT

5、echXchangeAI Workflow5IBM TechXchange|2024 IBM CorporationData Collection Text Extraction HAP Filtering TokenizationDataPretraining Fine Tuning Context Extension QuantizationTrainingIBM watsonx Embedded in Product Open Source Cloud/On-Prem or Service Hugging FaceDeploymentAdd Skills Add Knowledge(Fi

6、ne Tuning)(Fine Tuning)InstructLab#IBMTechXchangeAgenda010203Granite ModelsIBM AI Training Infrastructure-Blue VelaInstructLab on IBM CloudIBM TechXchange|2024 IBM CorporationMeet Blue Vela:IBMs Model Factory AI SupercomputerBlue Vela Compute Pods128 Dell XE9680 Compute Nodes1,024 NVIDIA H100 Tensor