AutoCine AI (also known as CineForge AI) is a cutting-edge web application that transforms a single sentence into a complete, production-ready cinematic short video package. Powered by advanced AI technologies, it streamlines professional video content creation by generating detailed scene descriptions, voice narration scripts, ambient audio prompts, and visual assets.
- One-Sentence to Full Video Package: Transform a simple idea into a complete cinematic experience
- Detailed Scene Generation: AI-powered creation of 5 interconnected professional scenes
- Voice Narration: Premium voice selection with multiple character types
- CapCut Export Format: Ready-to-edit format for professional video editing
- Authentication & Session Management: Secure user accounts with PostgreSQL integration
- Responsive Design: Optimized for desktop, tablet, and mobile devices
- Stable Diffusion Integration: High-quality AI video generation
- Visual Consistency Control: Main prompt feature for maintaining style across scenes
- Scene Management: Drag and drop interface for scene reordering
- Scene Regeneration: Selective regeneration of individual scenes
- ElevenLabs Integration: Professional-quality voice generation
- Voice Type Selection: Multiple voice styles (narrator, character, ambient, dramatic)
- Bulk Voice Generation: Generate narrations for all scenes simultaneously
- Real-time Progress Tracking: Visual progress bar with percentage completion
- Generation Cancellation: Ability to cancel in-progress voice generation
- Error Recovery: Robust retry logic and error handling
- Scene Customization: Edit all scene properties including prompts, voice lines, camera angles
- Voice Previews: Audio player with real-time playback
- Drag & Drop Reordering: Easy reorganization of scenes
- Responsive Layout: Optimized for all screen sizes
- CapCut-Ready Export: JSON and Markdown formats compatible with CapCut editor
- Metadata Handling: Proper formatting of titles, descriptions, and all scene attributes
- Asset Organization: Structured output for easy importing into video editing software
- React.js with TypeScript: Strong typing for better code quality
- TanStack React Query: Efficient state management and API interaction
- Shadcn UI Components: Consistent and accessible UI design
- Tailwind CSS: Responsive styling with dark-themed cinematic interface
- React DND: Drag-and-drop functionality for scene management
- Express.js: Fast and minimalist API server
- PostgreSQL with Drizzle ORM: Robust data persistence layer
- Authentication Middleware: Secure API endpoints and user session management
- Rate Limiting: Protection against API abuse
- OpenAI: Core content generation for scenes, scripts, and prompts
- Stable Diffusion: High-quality AI video generation
- ElevenLabs: Professional voice narration
- OpenSora: (Optional) Advanced video generation capabilities
- /api/generate/package: Generate a complete video package from an idea and style
- /api/generate/scene: Generate or regenerate a specific scene
- /api/voice/generate: Generate voice narration for a scene
- /api/voice/list: List available voice types
- /api/video/info: Check video generation service status
- /api/video/generate: Generate a video for a specific scene
- /api/packages/{id}: CRUD operations for saved packages
- /api/user: User authentication and management endpoints
- /api/settings: Update API settings and preferences
- /api-keys: Manage integration API keys (OPENAI_API_KEY, ELEVENLABS_API_KEY, STABLEDIFFUSION_API_KEY)
- Advanced Video Controls: Customize video duration, resolution, and generation parameters
- Voice Customization: Fine-tuning of voice parameters (speed, pitch, emotion)
- Custom Voice Training: Upload voice samples for personalized narration
- Music Generation: AI-generated background music that matches scene mood
- Scene Templates: Pre-configured templates for common video types
- AI Director Mode: Intelligent suggestions for scene improvement
- Collaborative Editing: Multi-user collaboration on video projects
- Version History: Track changes and restore previous versions
- Export to More Formats: Support for additional video editing software
- Enhanced Preview Generation: Real-time visual previews during editing
- Adobe Premiere Pro Integration: Direct export to Adobe Premiere Pro
- YouTube/Social Media Upload: Direct publishing to social platforms
- OpenSora Full Support: Advanced AI video generation integration
- Custom Font Support: Add personalized typography to exported content
AutoCine AI requires the following API keys for full functionality:
- OPENAI_API_KEY: Required for scene generation and prompt engineering
- ELEVENLABS_API_KEY: Required for voice narration generation
- STABLEDIFFUSION_API_KEY: Required for video generation
- OPENSORA_API_KEY: Optional for advanced video generation capabilities
Add your API keys in the API Settings section after logging in.
- Input Phase: Enter your idea and select a cinematic style
- Generation Phase: AI creates a full 5-scene package with all needed assets
- Editing Phase: Customize scenes, reorder, regenerate, and add voice narration
- Export Phase: Export to CapCut or other formats for final production
# Clone the repository
git clone https://github.com/yourusername/autocine-ai.git
# Install dependencies
npm install
# Setup environment variables
cp .env.example .env
# Add your API keys to .env
# Setup database
npm run db:push
# Start the development server
npm run devAutoCine AI is licensed under the MIT License. See the LICENSE file for more information.
AutoCine AI — Transform one sentence into cinematic magic.