Colossal-AI
latest

API REFERENCE

  • colossalai
    • colossalai.amp
    • colossalai.builder
    • colossalai.communication
    • colossalai.context
      • colossalai.context.process_group_initializer
      • colossalai.context.random
      • colossalai.context.config
      • colossalai.context.moe_context
      • colossalai.context.parallel_context
      • colossalai.context.parallel_mode
      • colossalai.context.singleton_meta
    • colossalai.engine
    • colossalai.kernel
    • colossalai.logging
    • colossalai.nn
    • colossalai.registry
    • colossalai.testing
    • colossalai.trainer
    • colossalai.utils
    • colossalai.zero
    • colossalai.initialize

Useful links for Colossal-AI

  • Colossal-AI Examples
  • Colossal-AI Benchmarks
  • Colossal-AI Tutorial
Colossal-AI
  • »
  • colossalai »
  • colossalai.context
  • Edit on GitHub

colossalai.context

  • colossalai.context.process_group_initializer
    • colossalai.context.process_group_initializer.initializer_1d
    • colossalai.context.process_group_initializer.initializer_2d
    • colossalai.context.process_group_initializer.initializer_2p5d
    • colossalai.context.process_group_initializer.initializer_3d
    • colossalai.context.process_group_initializer.initializer_data
    • colossalai.context.process_group_initializer.initializer_model
    • colossalai.context.process_group_initializer.initializer_pipeline
    • colossalai.context.process_group_initializer.initializer_sequence
    • colossalai.context.process_group_initializer.initializer_tensor
    • colossalai.context.process_group_initializer.process_group_initializer
  • colossalai.context.random
    • colossalai.context.random.seed_manager
  • colossalai.context.config
  • colossalai.context.moe_context
  • colossalai.context.parallel_context
  • colossalai.context.parallel_mode
  • colossalai.context.singleton_meta
Previous Next

© Copyright 2022, HPC-AI Tech. Revision a444633d.

Built with Sphinx using a theme provided by Read the Docs.
Read the Docs v: latest
Versions
latest
stable
Downloads
On Read the Docs
Project Home
Builds