StreamSculpt: Live Video Streaming Platforms

StreamSculpt is an interactive live streaming app that enhances the user experience by making the streaming process more interactive, engaging, and visual. The platform integrates technologies such as AI-driven stream recognition, augmented reality, 3D overlay, virtual camera, and customizable live streaming events to offer an immersive live-streaming experience.

The app helps the streamers to establish connection via Twitch, configure the streaming setup, choose and customize 3D overlays, configure alerts, schedule events, and show message templates while streaming. The use of a virtual camera allows the app to utilize feeds from the camera when another app is accessing the physical camera. The application was built using ReactJS, ElectronJS, Node.js, and MongoDB.

• Improve the live-streaming experience using augmented reality and 3D visuals.
• Ensure seamless integration with the Twitch account.
• Ensure AI-based streamer recognition for the augmented reality experience.
• Allow customization of 3D overlays and streaming alerts.
• Allow scheduling of events using timed overlays.
• Include a virtual camera feature for continuous streaming.
• Create a user-friendly dashboard for configuring the streaming settings.

1. Creating Interactive Streaming

The customer aimed to increase the level of interactivity of live streaming by using augmented reality and 3D visual effects. The task was to blend camera footage from the real world with computer visuals in order to not to complicate the live streaming process for users.

2. Ensuring Video Quality

AR, 3D effects, and live video streaming can require some computing power and resources. It was crucial to ensure proper performance and quality of video output while processing these visual elements.

3. Overwriting the Streamer's Existing Camera Connection

Streamers might be using another software application to access their physical webcam. It was necessary to ensure that the platform could process camera footage without any conflicts with existing applications.

4. Complicated Configuration Process

It becomes complicated to manage overlays, alerts, events, message templates, and other parameters when configuring live streaming. A simple dashboard and streamlined configuration process were needed.

5. Interactive Elements on Live Streams

There should be support for different events in live streaming, like subscriptions, followers, gifted subscriptions, raids, re-subscriptions, and cheers.

Twitch Login

Users can securely access StreamSculpt using their Twitch account, providing a simple authentication experience for streamers.

Streamer Recognition

AI-powered streamer recognition identifies the streamer within the video stream to support seamless AR integration.

Easy Setup

The application provides a simplified setup process to help users configure their streaming environment quickly.

Dashboard

Users can manage saved 3D overlays, streaming configurations, alerts, events, and other application settings from their dashboard.

3D Overlays

Streamers can select from a range of 3D overlays to enhance their live video content with interactive visual elements.

Streaming Alerts

Users can configure alerts for different streaming activities, including subscriptions, new followers, gifted subscriptions, re-subscriptions, raids, and cheers.

Event Scheduling

Users can schedule streaming events at specific time intervals and assign different overlays to be displayed during the selected periods.

Message Templates

Users can create customized messages to display during live streams. They can configure text, font size, font type, position, bouncing effects, shadow effects, and other visual properties.

Custom Overlay

Users can request personalized 3D overlays designed around their branding and streaming requirements by submitting their requirements through a dedicated form.

Virtual Camera

The virtual camera allows the processed video feed to be accessed by other applications while the physical webcam is being used, supporting flexible streaming workflows.