利用生成式人工智能对OCP交换机进行诊断测试.pdf

1、Wei-Jen HuangDistinguished EngineerCiscoDiagnostics Testing on OCP Switch with Generative AIChih-Tsung HuangSenior DirectorCiscoDiagnostics Testing on OCP Switch with Generative AIWei-Jen HuangDistinguished EngineerCiscoTEST&VALIDATIONChih-Tsung HuangSenior DirectorCisco100 Million Active Users35x 7

2、0 monthsUber61 monthsTelegram55 monthsSpotify41 monthsPinterest30 monthsInstagram9 monthsTik TokChatGPT2 monthsResponsePromptClassic Large Language ModelLLMRapid Large Language Model EvolutionFine TunedCustomLargeLanguageModelRetrieval Augmented GenerationEnhancedLargeLanguageModelAgentsAgenticLarge

3、LanguageModelSubAgentsMulti-AgentLargeLanguageModelClassicLarge Language ModelPreTrainedPromptResponsePost-TrainedLarge Language Model Evolution IllustratedFine TunedDataRAGAgent LoopActionPost-TrainedFine TunedtaRAGToolsActionPost-TrainedFine TunedtaRAGToolsPost TrainedFine TunedRetrieval Augmented

4、 GenerationAgenticSub AgentsAgent LoopAgent LoopAgent LoopAgent LoopCisco 850164x800GCisco Silicon One3rdParty NOSSONiCCisco IOSxDVT LogsSWQA LogsManufacturing LogsRetrieval Augmented GenerationLarge Language Model Knowledge BaseSDKSAIUser GuideRegister SpecFine tuned ModelPretrained ModelLlamaGemma

5、QwenSwitch Test DevelopmentTraditional StepsComplexity for Generative AIPlanning-To test a switch in diagnostics mode,which areas need validation?-Which components need to be covered and how should they be operated?-What connectivity needs to be covered?-Create an integrated test which can cover as

6、many components as possible to minimize test time and jointly provide the maximum stress condition?-When an error happens,what are the steps needed to isolate?-Complexity is low-Based on experience with RAG DependencyExecution:Test Development-Write and run a test case from scratch-Map physical port