Hand sketch in, editable parametric FreeCAD model out

Nov 09, 2026 Last reply: 19 hours ago 3 Replies
Jump to replies (3)

The detail that caught me off guard is that the tool talks back. When the vision model spots an ambiguous or missing dimension on a drawing, the system generates clarification questions and the user answers them in a web form. Most conversion attempts I have seen just guess and hand you something broken, so a built-in checkpoint for uncertain dimensions seems like a genuinely thoughtful step in the pipeline.



The flow itself is straightforward to follow. You feed in a 2D engineering drawing or a hand sketch, Meta's MuseSpark vision model processes it, and the system produces named sketches and CAD features. A local web interface hosts the whole pipeline, with an interactive Three.js viewer for the resulting part and a 'Drawing vs Modeling matching table' so you can check the model against the original. The output directory holds the generated Python scripts, log files, STEP models and a FreeCAD document.



The demonstration uses a 2D mechanical drawing of an external gear with 30 teeth. The generated file opens in FreeCAD with a parametric feature tree, and when a dimension is altered the model updates and rebuilds on its own. That the sketch and feature history survive the conversion is the part worth celebrating. Files come out as .FCStd and STEP.



The maker built this because existing text-to-CAD tools produced uneditable STEP files, which is a problem I recognize. One trade-off to weigh: the project depends on an AI to run, so it is not a fully offline, self-contained converter.



Project by Vibe Coding in my Workshop. Watch it on their YouTube channel:

formatting link


The clarification step is the smartest part of this for me. Asking the user when a dimension is ambiguous beats silently inventing a value that looks right in the viewer but fails at print time. It adds friction to the workflow, but for mechanical parts that friction is exactly where it should sit.

How does the vision model handle a hand sketch with no dimensions at all? The clarification questions clearly cover ambiguous or missing values, but I am curious whether a fully undimensioned sketch triggers a long list of questions or whether the system treats that as a different case entirely.

One concrete addition: keep a copy of the 'Drawing vs Modeling matching table' in the output directory alongside the logs and scripts. Right now it lives in the web interface, and having it saved next to the FreeCAD document would give you a permanent record of what the model claims to match in the original drawing.

Join the Discussion

Have something to add? Share your thoughts — no account required.

Didn't find your answer?

Ask the community — no account required