Project Details
The problem
A consistent short-form content habit has a hard bottleneck that has nothing to do with filming: turning raw footage into something worth posting takes real editing time, every single day, and that time cost is exactly what makes a “post daily” habit fail in practice long before the content itself is the limiting factor.
What was built
A full overnight pipeline, unattended end to end except for one deliberate human checkpoint near the end:
- Automatic offload: footage moves off the camera and into a permanent archive on its own, with verification before anything is deleted from the camera.
- Silence-based editing: dead air and silence get cut automatically based on audio, before transcription. That means the transcript that gets generated afterward already lines up with the edited video, and the (comparatively expensive) transcription step only runs on footage that survived the cut.
- Local speech-to-text transcription.
- AI highlight and hook scoring: a local language model scores windows of the transcript for how likely they are to be worth clipping, rather than a person scrubbing through raw footage looking for moments.
- Vertical-format rendering of the scored highlights.
- A human approval step: every clip and its caption go through a quick approve/reject checkpoint before anything posts. Nothing publishes itself.
- Scheduled multi-platform posting through a social-scheduling integration, after approval.
Two things beyond that core chain are worth calling out on their own:
The system listens to its own footage for feature requests. An offhand comment spoken on camera (“I should really make this thing also do X”) gets picked up from the transcript and turned into a real, tracked follow-up item, rather than being lost the moment the camera stops recording.
Privacy-preserving content gating is built and tested, not just designed. Location metadata is stripped before anything is scored or rendered, verified with a real, dynamic check that no geolocation data ever survives into what gets persisted or published, not just a read of the code. A separate gate governs whether other people’s faces appearing in raw footage are allowed into rendered output. Both exist because a home-based content creator publishing frequent footage has a real, documented physical-security exposure (geotagged or context-rich posts are a known “away from home right now” signal), and because footage inevitably includes other people who never consented to being in a publishing pipeline. The fix belongs in the pipeline itself, applied automatically, not left as something to remember by hand on every single clip.
Technology choices, and why
Silence-cut editing before transcription, not after. Cutting on raw audio loudness needs no transcript at all, so it can run first, and running it first means the (slower) transcription step only processes footage that made the cut, and its timestamps already match the edited video rather than needing to be re-aligned afterward.
Local models as the default, not a fallback. Transcription and highlight scoring both run on local, self-hosted models by default: free, private, and fast enough for an overnight batch job, with the same standing discipline used everywhere else across this builder’s work: no AI-touching step depends on exactly one provider being available.
Remote compute offload with automatic, verified fallback. The heaviest processing steps can dispatch to a second, more capable machine on the same private network when it’s available, and fall back to running locally when it isn’t. That includes a real case where the remote path was capable of most of a step but missing one specific capability, correctly detected and handled by falling back rather than silently producing a broken result. Treating “the fast path might not always be available” as the normal case, not an edge case, is what makes an unattended overnight job actually reliable.
A human checkpoint at exactly one point, chosen deliberately. Every earlier stage runs unattended because none of it is public-facing yet; approval sits at the one point where a mistake would actually reach an audience. Automating everything up to that line and nothing past it is the design, not an oversight.
Outcome
Real, running, unattended: footage goes in overnight and comes out the other side as edited, captioned, vertical clips waiting in an approval queue by morning, including the privacy-gating checks, which have their own dedicated real tests (not mocks) confirming they actually catch what they’re meant to catch. The self-listening feature-request detection has surfaced and tracked real follow-up ideas straight from spoken commentary.
This same pipeline is also, as of this year, evolving beyond personal use into the foundation for a broader content-operations capability: the same edit → score → approve → publish shape, generalized toward social-media management as a service rather than a single person’s own footage.