AR Creation Tool for Custom Effects: Shader

In the rapidly evolving world of augmented reality (AR), a new player has emerged with the potential to democratize AR content creation. Shader, founded by former Snap design lead Darya Sesitskaya, is a groundbreaking AR creation tool that leverages artificial intelligence (AI) to enable users to generate custom effects, 2D masks, and lenses with unprecedented ease and speed. This innovative platform is poised to challenge established industry giants, such as Snap’s Lens Studio and TikTok’s Effect House, by offering a no-code solution that simplifies the AR creation process.

A New Era of AR Content Creation

Shader’s platform is built upon the open-source Stable Diffusion model, which allows users to input text-based prompts to generate their AR creations. This approach significantly reduces the time and technical expertise required to create engaging AR filters, which traditionally could take hours and necessitate advanced engineering and design skills. The startup’s team, comprising former Snap AR and Blizzard engineers, brings a wealth of experience to the table, promising a robust and user-friendly platform.

The Birth of Shader

The inception of Shader can be traced back to the vision of Darya Sesitskaya, who played a pivotal role in designing Snapchat’s AR camera, Lens Studio, Lens Cloud, and more. Her experience at Wanna, an AR technology company known for its virtual try-ons, further solidified her expertise in the field. With Shader, Sesitskaya aims to make AR/AI effects accessible to everyone, empowering users to create personalized content effortlessly.

Shader’s Flagship Product: A Real-Time AI Camera App

Launched in beta on iOS devices in December 2023, Shader’s flagship product is a real-time AI camera app that transforms the way users interact with AR. By simply taking a photo and entering a prompt, users can generate personalized AR effects and record videos of themselves wearing the mask or filter. Although the results during testing were on the simpler

Expanding Accessibility and Interactivity

Shader is not just about creating AR effects; it’s about sharing and interacting with them. The app’s cross-platform functionality enables users to showcase their exclusive filters on Instagram, TikTok, and Snapchat. An upcoming in-app social feed will further enhance this experience by allowing users to post their templates, engage with others’ creations, and try out new effects. This social aspect of Shader could significantly impact how creators collaborate and share AR content.

Beyond the App: Shader’s Web Version and Future Plans

Shader’s ambition extends beyond its mobile app. The recent launch of a web version that scans faces with a built-in webcam and accepts text prompts is a testament to the company’s commitment to making AR creation more accessible. Furthermore, Shader is optimizing its iOS app for the newly released Vision Pro and offering an API and plug-in for companies to integrate its technology into their products.

Funding and Future Developments

With $580,000 raised from notable investors, Shader is on a solid footing to expand its offerings. The funding will support the development of new features, such as speech-to-text prompts and integration with platforms like Twitch, Discord, and Zoom, enabling live AR filters. These advancements, along with plans to implement voice-to-AR effects and 3D background replacements, underscore Shader’s mission to revolutionize AR content creation.

Conclusion: A Bright Future for AR Creation

Shader represents a significant leap forward in making AR content creation accessible and enjoyable for a broader audience. By harnessing the power of AI and focusing on user-friendly design principles, Shader is not just a tool but a platform that opens up new possibilities for the 400 million creators on social media. As Shader continues to evolve and expand its capabilities, it stands to redefine the landscape of AR creation, making it more inclusive and creative than ever before.