aws-ai-ml
Selects, deploys, and customizes AI models on Amazon SageMaker. Training or Processing jobs, fine-tuning (SFT/DPO/RLVR/RLAIF), model selection, dataset preparation, evaluation, SageMaker or Bedrock deployment, inference optimization and endpoint diagnostics. Covers the full lifecycle from planning through production. Use when fine-tuning models on SageMaker, choosing which base model to customize, fine-tune, or deploy from SageMaker JumpStart or Hub, SageMakerPublicHub, or the SageMaker public model catalog, transforming or validating training data, evaluating model quality, deploying or optimizing endpoints, configuring IAM/S3 for training, or managing SageMaker Managed MLflow. Use for endpoint health, failures, latency, logs, metrics, errors. Covers Serverless Model Customization, Nova and OSS deployment paths, and PySDK v3. NOT for Ground Truth labeling, Feature Store, or general-purpose AWS infrastructure.
- Version
- 5
Pinned to revision a2c98f2037dc, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/aws-ai-ml/SKILL.md
- skills/aws-ai-ml/references/dataset-evaluation/overview.md
- skills/aws-ai-ml/references/dataset-evaluation/references/custom-scorer-evaluation-dataset-formats.md
- skills/aws-ai-ml/references/dataset-evaluation/references/strategy_data_requirements.md
- skills/aws-ai-ml/references/dataset-evaluation/scripts/format_detector.py
- skills/aws-ai-ml/references/dataset-transformation/code_templates/transformation.py
- skills/aws-ai-ml/references/dataset-transformation/overview.md
- skills/aws-ai-ml/references/dataset-transformation/references/code_output_guide.md
- skills/aws-ai-ml/references/dataset-transformation/references/dataset_transformation_code.md
- skills/aws-ai-ml/references/dataset-transformation/references/sagemaker_dataset_formats.md
- skills/aws-ai-ml/references/dataset-transformation/scripts/transformation_tools.py
- skills/aws-ai-ml/references/directory-management/overview.md
- skills/aws-ai-ml/references/endpoint-diagnostics/overview.md
- skills/aws-ai-ml/references/endpoint-diagnostics/references/minimum_iam_policy.md
- skills/aws-ai-ml/references/endpoint-diagnostics/scripts/collect_diagnostics.py
- skills/aws-ai-ml/references/finetuning-technique/overview.md
- skills/aws-ai-ml/references/finetuning-technique/references/finetune_technique_selection_guide.md
- skills/aws-ai-ml/references/finetuning-technique/scripts/get_recipes.py
- skills/aws-ai-ml/references/finetuning/code_templates/dpo.py
- skills/aws-ai-ml/references/finetuning/code_templates/rlaif_builtin.py
- skills/aws-ai-ml/references/finetuning/code_templates/rlaif_custom_prompt.py
- skills/aws-ai-ml/references/finetuning/code_templates/rlvr.py
- skills/aws-ai-ml/references/finetuning/code_templates/sft.py
- skills/aws-ai-ml/references/finetuning/overview.md
- skills/aws-ai-ml/references/finetuning/references/code_output_guide.md
- skills/aws-ai-ml/references/finetuning/references/continuous_customization.md
- skills/aws-ai-ml/references/finetuning/references/eula_links.md
- skills/aws-ai-ml/references/finetuning/references/rlaif_guide.md
- skills/aws-ai-ml/references/finetuning/references/rlvr_reward_function.md
- skills/aws-ai-ml/references/finetuning/scripts/mlflow_reference.py
- skills/aws-ai-ml/references/finetuning/templates/nova_rlvr_reward_function_source_template.py
- skills/aws-ai-ml/references/finetuning/templates/rlvr_reward_function_source_template.py
- skills/aws-ai-ml/references/manage-mlflow/overview.md
- skills/aws-ai-ml/references/manage-mlflow/references/app-creation-workflow.md
- skills/aws-ai-ml/references/manage-mlflow/references/app-deletion-workflow.md
- skills/aws-ai-ml/references/manage-mlflow/references/app-discovery-workflow.md
- skills/aws-ai-ml/references/manage-mlflow/references/app-update-workflow.md
- skills/aws-ai-ml/references/manage-mlflow/references/sm-mlflow-guide.md
- skills/aws-ai-ml/references/model-deployment/code_templates/deploy-jumpstart-sagemaker.py
- skills/aws-ai-ml/references/model-deployment/code_templates/deploy-nova-bedrock.py
- skills/aws-ai-ml/references/model-deployment/code_templates/deploy-nova-sagemaker.py
- skills/aws-ai-ml/references/model-deployment/code_templates/deploy-oss-bedrock.py
- skills/aws-ai-ml/references/model-deployment/code_templates/deploy-oss-sagemaker.py
- skills/aws-ai-ml/references/model-deployment/code_templates/optimize-benchmark.py
- skills/aws-ai-ml/references/model-deployment/code_templates/optimize-huggingface-to-s3.py
- skills/aws-ai-ml/references/model-deployment/code_templates/optimize-recommendation.py
- skills/aws-ai-ml/references/model-deployment/overview.md
- skills/aws-ai-ml/references/model-deployment/references/code_output_guide.md
- skills/aws-ai-ml/references/model-deployment/references/deploy-jumpstart-sagemaker.md
- skills/aws-ai-ml/references/model-deployment/references/deploy-nova-bedrock.md
- skills/aws-ai-ml/references/model-deployment/references/deploy-nova-sagemaker.md
- skills/aws-ai-ml/references/model-deployment/references/deploy-oss-bedrock.md
- skills/aws-ai-ml/references/model-deployment/references/deploy-oss-sagemaker.md
- skills/aws-ai-ml/references/model-deployment/references/model-licenses.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/benchmark-workflow.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/benchmarking-guidance.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/huggingface-to-s3.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/interpreting-results.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/recommendation-deploy.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/recommendation-options.md
- skills/aws-ai-ml/references/model-deployment/references/optimization/recommendation-workflow.md
- skills/aws-ai-ml/references/model-evaluation/code_templates/custom_scorer_evaluator.py
- skills/aws-ai-ml/references/model-evaluation/code_templates/llmaaj_evaluator.py
- skills/aws-ai-ml/references/model-evaluation/overview.md
- skills/aws-ai-ml/references/model-evaluation/references/code_output_guide.md
- skills/aws-ai-ml/references/model-evaluation/references/create-reward-function.md
- skills/aws-ai-ml/references/model-evaluation/references/custom-lambda-scorer.md
- skills/aws-ai-ml/references/model-evaluation/references/custom-scorer-evaluation.md
- skills/aws-ai-ml/references/model-evaluation/references/evaluation-type-guide.md
- skills/aws-ai-ml/references/model-evaluation/references/llmaaj-builtin-evaluation.md
- skills/aws-ai-ml/references/model-evaluation/references/llmaaj-custom-evaluation.md
- skills/aws-ai-ml/references/model-evaluation/references/llmaaj-evaluation.md
- skills/aws-ai-ml/references/model-evaluation/references/supported-judge-models.md
- skills/aws-ai-ml/references/model-evaluation/scripts/nova_reward_function_source_template.py
- skills/aws-ai-ml/references/model-evaluation/scripts/reward_function_source_template.py
- skills/aws-ai-ml/references/model-evaluation/scripts/validate_custom_metrics.py
- skills/aws-ai-ml/references/model-selection/overview.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/agentic-index.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/coding-index.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/gpqa.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/hle.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/ifbench.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/intelligence-index.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/mmmu-pro.md
- skills/aws-ai-ml/references/model-selection/references/benchmarks/tau2.md
- skills/aws-ai-ml/references/model-selection/references/model-licenses.md
- skills/aws-ai-ml/references/model-selection/references/model-selection.md
- skills/aws-ai-ml/references/model-selection/references/select-for-deployment.md
- skills/aws-ai-ml/references/model-selection/scripts/filter_deployable_models.py
- skills/aws-ai-ml/references/model-selection/scripts/get_deployable_models.py
- skills/aws-ai-ml/references/model-selection/scripts/get_model_names.py
- skills/aws-ai-ml/references/model-selection/scripts/search_deployable_models.py
- skills/aws-ai-ml/references/planning/overview.md
- skills/aws-ai-ml/references/planning/references/deploy-base-model-plan.md
- skills/aws-ai-ml/references/planning/references/evaluate-first-plan.md
- skills/aws-ai-ml/references/planning/references/input-output-contracts.md
- skills/aws-ai-ml/references/planning/references/model-customization-plan.md
- skills/aws-ai-ml/references/planning/references/region-availability.md
- skills/aws-ai-ml/references/planning/references/skill-routing-constraints.md
- skills/aws-ai-ml/references/processing-jobs/code_templates/dataset_definition_processing.py
- skills/aws-ai-ml/references/processing-jobs/code_templates/framework_processing.py
- skills/aws-ai-ml/references/processing-jobs/code_templates/script_processing.py
- skills/aws-ai-ml/references/processing-jobs/code_templates/spark_processing.py
- skills/aws-ai-ml/references/processing-jobs/overview.md
- skills/aws-ai-ml/references/processing-jobs/references/configuration.md
- skills/aws-ai-ml/references/processing-jobs/references/troubleshooting.md
- skills/aws-ai-ml/references/sdk-getting-started/overview.md
- skills/aws-ai-ml/references/sdk-getting-started/references/execution-role-setup.md
- skills/aws-ai-ml/references/sdk-getting-started/references/sagemaker-python-sdk-setup.md
- skills/aws-ai-ml/references/training-jobs/code_templates/custom_training.py
- skills/aws-ai-ml/references/training-jobs/code_templates/jumpstart_training.py
- skills/aws-ai-ml/references/training-jobs/code_templates/recipe_training.py
- skills/aws-ai-ml/references/training-jobs/overview.md
- skills/aws-ai-ml/references/training-jobs/references/configuration.md
- skills/aws-ai-ml/references/training-jobs/references/troubleshooting.md
- skills/aws-ai-ml/references/use-case-specification/overview.md
- skills/aws-ai-ml/references/use-case-specification/references/spec-for-deployment.md
- skills/aws-ai-ml/references/use-case-specification/references/spec-for-finetuning.md
Every link opens the file at its source, pinned to the revision this page describes.