PrepPilotPractise free

MLOps interview questions

Training pipelines, model serving, monitoring, drift

17 questions · model v2 · updated November 2026

Practise these as flashcards. One or two lines each; the ones you miss come back first.

Start free

Core questions

What is MLOps and why is it important?

MLOps is the practice of applying DevOps principles to machine learning workflows. It automates and streamlines the ML lifecycle, making model deployment, monitoring, and maintenance more reliable and scalable.

How does experiment tracking help in ML projects?

Experiment tracking records parameters, metrics, and artifacts for each model run. This helps compare results, reproduce experiments, and select the best models for deployment.

What is a feature store and why is it used?

A feature store is a centralized repository for storing and serving features used in ML models. It ensures consistency between training and inference, prevents feature leakage, and streamlines feature engineering.

What is the difference between batch and online model serving?

Batch serving processes predictions for large datasets at scheduled intervals, while online serving provides real-time predictions via APIs. Online serving requires low latency and is used for time-sensitive applications.

Intermediate questions

How does MLflow help with model registry and deployment?

MLflow provides a model registry to store, version, and manage models. It allows promoting models through lifecycle stages like staging and production, and integrates with deployment tools for automated rollout.

What steps would you include in a CI/CD pipeline for ML models?

A typical CI/CD pipeline includes data validation, model training, unit and integration tests, evaluation against benchmarks, model registry update, and automated deployment. This ensures reproducibility and reduces manual errors.

How do you monitor for data drift in production?

I monitor data drift by comparing statistical distributions of incoming data to the training data using tests like KS or Chi-squared. Alerts are triggered if significant drift is detected, prompting investigation or retraining.

What is concept drift and how can it affect model performance?

Concept drift occurs when the relationship between features and target changes over time. This can cause model predictions to become less accurate, requiring retraining or model updates to maintain performance.

How does a feature store prevent feature leakage?

Feature stores manage feature versioning and access, ensuring that only valid features are used during training and inference. They enforce data boundaries and prevent using future information in training, which avoids leakage.

How do you ensure reproducibility in ML pipelines?

I use version control for code and data, fixed random seeds, environment management tools like Docker, and experiment tracking platforms. This allows anyone to rerun the pipeline and obtain the same results.

What are the benefits of A/B testing for model deployment?

A/B testing allows comparing different model versions on real users, measuring performance and impact before full rollout. It helps identify the best model and reduces risk of deploying underperforming models.

How do you version models and their associated data?

I use tools like MLflow for model versioning and DVC for data versioning. Each model version is linked to a specific dataset snapshot, ensuring traceability and reproducibility across experiments and deployments.

Senior questions

Describe a scenario where you would use shadow deployment for a new model.

See the answer in the app, free

How do you handle performance decay in deployed models?

See the answer in the app, free

What are the trade-offs between batch and online serving for ML models?

See the answer in the app, free

How would you design a monitoring system for both data drift and concept drift?

See the answer in the app, free

How do you ensure safe and reproducible model updates in production?

See the answer in the app, free

More Machine Learning & AI topics