Add Docker support by WolffM · Pull Request #253 · microsoft/data-formulator

WolffM · 2026-03-14T13:09:20Z

Summary

Fixes #85: Add Docker support

Changes

This PR addresses the issue described above. Changes were developed on the fix/85-add-docker-support branch.

Related Issue

Closes Docker Support #85

…ment)

WolffM · 2026-03-14T15:13:11Z

@microsoft-github-policy-service agree

Copilot

Pull request overview

Adds first-class Docker artifacts to run Data Formulator via docker compose / docker build, bundling the Vite-built frontend into the Python runtime image and documenting container usage.

Changes:

Introduces a multi-stage Dockerfile to build the frontend and ship a Python runtime image that serves the bundled UI.
Adds docker-compose.yml and .dockerignore for easier local deployment and smaller build contexts.
Adds a minimal sandbox image Dockerfile and Docker usage documentation.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
py-src/data_formulator/sandbox/Dockerfile.sandbox	Adds a minimal Python sandbox image definition for Docker-based code execution.
docker-compose.yml	Defines a compose service for running Data Formulator with persisted workspace data.
Dockerfile	Adds multi-stage Docker build (frontend build + Python runtime image).
DEVELOPMENT.md	Documents Docker quick-start and sandbox limitations in containers.
.dockerignore	Reduces Docker build context size and avoids leaking local artifacts/secrets.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Dockerfile

+# Create a non-root user to run the application
+RUN useradd -m -s /bin/bash appuser
+


docker-compose.yml

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Adds first-class Docker artifacts to run Data Formulator via docker build / docker compose, including a separate minimal image intended for the Docker-based sandbox backend.

Changes:

Added a multi-stage Dockerfile (Node build stage + Python runtime stage) and a docker-compose.yml for local deployment.
Added a minimal Dockerfile.sandbox for the Docker sandbox backend image.
Documented Docker usage in DEVELOPMENT.md and added a .dockerignore.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
py-src/data_formulator/sandbox/Dockerfile.sandbox	Defines a minimal Python image for the Docker sandbox backend.
docker-compose.yml	Compose service to run the app and persist workspace data in a named volume.
Dockerfile	Multi-stage build bundling the built frontend into the Python package image.
DEVELOPMENT.md	Adds Docker quick-start and notes about sandbox limitations in containers.
.dockerignore	Reduces build context size and avoids copying local artifacts/secrets into images.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

py-src/data_formulator/sandbox/Dockerfile.sandbox

+# Drop to a non-root user for extra isolation
+RUN useradd -m sandbox
+USER sandbox
+


docker-compose.yml

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Adds first-class Docker artifacts to run Data Formulator via a container image / Docker Compose, and introduces a minimal Docker image for the Docker-based sandbox backend.

Changes:

Added a multi-stage Dockerfile that builds the Vite frontend and installs the Python package into a slim runtime image.
Added docker-compose.yml and .dockerignore to support an easy local deployment workflow with persisted workspace data.
Added py-src/data_formulator/sandbox/Dockerfile.sandbox for building the data-formulator-sandbox image used by the Docker sandbox backend.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
py-src/data_formulator/sandbox/Dockerfile.sandbox	Defines a minimal Python image with data/ML deps for the Docker sandbox runtime.
docker-compose.yml	Compose setup to build/run the app and persist workspace data across restarts.
Dockerfile	Multi-stage build: frontend build (Node) + Python runtime image bundling built frontend.
DEVELOPMENT.md	Documents Docker quick-start and limitations of running the Docker sandbox from inside a container.
.dockerignore	Reduces Docker build context size and avoids copying secrets/caches into images.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

docker-compose.yml

+      - "5567:5567"
+    env_file:
+      - .env
+    user: "0:0"


Dockerfile

DEVELOPMENT.md

+
+To stop the container: `docker compose down`
+
+Workspace data (uploaded files, sessions) is persisted in a Docker volume (`data_formulator_home`) so it survives container restarts.


Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Adds containerization support to run Data Formulator via Docker/Docker Compose, aligning with the repo’s existing “bundle frontend into py-src/data_formulator/dist and serve via Flask” packaging approach.

Changes:

Added a multi-stage Dockerfile to build the frontend and install/serve the Python app in a runtime image.
Added docker-compose.yml for a one-command local run with persisted workspace data via a named volume.
Added a sandbox image Dockerfile (Dockerfile.sandbox), .dockerignore, and Docker usage documentation in DEVELOPMENT.md.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
`Dockerfile`	Multi-stage build: frontend build (Node) + Python runtime that installs the package and serves on port 5567
`docker-compose.yml`	Compose service definition, env file loading, port mapping, and a persistent volume for workspace data
`py-src/data_formulator/sandbox/Dockerfile.sandbox`	Minimal Python image intended for the Docker-based sandbox backend
`DEVELOPMENT.md`	Added Docker quickstart and clarified sandbox limitations when running inside containers
`.dockerignore`	Reduces Docker build context size and avoids copying local artifacts/secrets

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

py-src/data_formulator/sandbox/Dockerfile.sandbox

+# Drop to a non-root user for extra isolation
+RUN useradd -m sandbox
+USER sandbox
+


docker-compose.yml

+      - .env
+    user: "0:0"
+    volumes:
+      # Persist workspace data (uploaded files, sessions, etc.) across container restarts.
+      - data_formulator_home:/home/appuser/.data_formulator
+    restart: unless-stopped


Dockerfile

+# System dependencies needed by some Python packages
+RUN apt-get update && apt-get install -y --no-install-recommends \
+        gcc \
+        g++ \
+        libpq-dev \
+        unixodbc-dev \
+        curl \
+    && rm -rf /var/lib/apt/lists/*


Remove user: "0:0" override in docker-compose.yml — the Dockerfile already creates /home/appuser/.data_formulator and chowns it to appuser before switching to USER appuser, so the override was causing the app to run as root and write to /root/.data_formulator, bypassing the mounted volume entirely. Pass --user with host uid:gid to docker run in DockerSandbox so the sandbox container UID matches the host user that created the bind-mounted output directory. Without this, the non-root sandbox user cannot write the output parquet file, silently breaking all Docker sandbox executions.

WolffM · 2026-03-18T00:49:33Z

hey @Chenglong-MS, i think the comments are addressed now. thanks for taking a look.

Copilot

Pull request overview

Adds first-class Docker deployment support for Data Formulator (closes #85), including containerizing the full build (frontend + Python runtime) and documenting Docker usage.

Changes:

Adds a multi-stage Dockerfile to build the frontend and package it into a Python runtime image.
Adds docker-compose.yml plus .dockerignore for easier local deployment and persistence of workspace data.
Updates the Docker-based sandbox runner to run containers as the host user (UID/GID) to avoid permission issues on bind mounts, and adds a dedicated sandbox Dockerfile.sandbox.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
py-src/data_formulator/sandbox/docker_sandbox.py	Runs docker sandbox containers as the invoking host UID/GID.
py-src/data_formulator/sandbox/Dockerfile.sandbox	Defines a minimal Python sandbox image with common data libraries.
docker-compose.yml	Adds compose config to build/run the app with a persisted workspace volume.
Dockerfile	Adds multi-stage image build (Node build stage + Python runtime stage).
DEVELOPMENT.md	Documents Docker quickstart and limitations around docker-in-docker sandboxing.
.dockerignore	Reduces Docker build context size and avoids copying secrets like `.env`.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

py-src/data_formulator/sandbox/docker_sandbox.py

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Chenglong-MS · 2026-03-18T00:57:45Z

seems good! let me do a little test and merge it! 🚀

WolffM added 3 commits March 13, 2026 14:53

Configure pipeline: copilot instructions, CI, and static analysis

d34ae91

Switch copilot-setup-steps to github-hosted runners (firewall enforce…

2350dca

…ment)

Add Docker support

e1a890e

WolffM force-pushed the fix/85-add-docker-support branch from c44ab8a to e1a890e Compare March 14, 2026 14:50

WolffM mentioned this pull request Mar 14, 2026

Docker Support #85

Open

Chenglong-MS requested a review from Copilot March 15, 2026 17:16

Copilot started reviewing on behalf of Chenglong-MS March 15, 2026 17:17 View session

Copilot AI reviewed Mar 15, 2026

View reviewed changes

Dockerfile

Comment on lines +35 to +37

# Create a non-root user to run the application

RUN useradd -m -s /bin/bash appuser

docker-compose.yml Outdated Show resolved Hide resolved

Potential fix for pull request finding

3080868

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Chenglong-MS changed the base branch from main to dev March 16, 2026 17:42

Chenglong-MS requested a review from Copilot March 16, 2026 22:15

Copilot started reviewing on behalf of Chenglong-MS March 16, 2026 22:16 View session

Copilot AI reviewed Mar 16, 2026

View reviewed changes

py-src/data_formulator/sandbox/Dockerfile.sandbox

Comment on lines +22 to +25

# Drop to a non-root user for extra isolation

RUN useradd -m sandbox

USER sandbox

docker-compose.yml Show resolved Hide resolved

Potential fix for pull request finding

9b5b8ee

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Chenglong-MS requested a review from Copilot March 16, 2026 22:33

Copilot started reviewing on behalf of Chenglong-MS March 16, 2026 22:33 View session

Copilot AI reviewed Mar 16, 2026

View reviewed changes

Potential fix for pull request finding

dc0bd46

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Chenglong-MS requested a review from Copilot March 16, 2026 23:05

Copilot started reviewing on behalf of Chenglong-MS March 16, 2026 23:06 View session

Copilot AI reviewed Mar 16, 2026

View reviewed changes

Chenglong-MS requested a review from Copilot March 18, 2026 00:50

Copilot started reviewing on behalf of Chenglong-MS March 18, 2026 00:51 View session

Copilot AI reviewed Mar 18, 2026

View reviewed changes

py-src/data_formulator/sandbox/docker_sandbox.py Outdated Show resolved Hide resolved

Potential fix for pull request finding

aafa73d

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Docker support#253

Add Docker support#253
WolffM wants to merge 8 commits intomicrosoft:devfrom
WolffM:fix/85-add-docker-support

WolffM commented Mar 14, 2026

Uh oh!

WolffM commented Mar 14, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

WolffM commented Mar 18, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Chenglong-MS commented Mar 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

		# Create a non-root user to run the application
		RUN useradd -m -s /bin/bash appuser


		To stop the container: `docker compose down`

		Workspace data (uploaded files, sessions) is persisted in a Docker volume (`data_formulator_home`) so it survives container restarts.

Conversation

WolffM commented Mar 14, 2026

Summary

Changes

Related Issue

Uh oh!

WolffM commented Mar 14, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

WolffM commented Mar 18, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Chenglong-MS commented Mar 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants