In collaboration with [Heineken](https://www.heineken.com) and [LePub](https://www.le.pub/), we developed "Trash & Win," an innovative digital platform that promotes sustainable behaviour. By integrating **AI** and **AR**, this initiative turns every Heineken bottle into an opportunity to win prizes, revolutionizing how we think about waste management.

"Trash & Win" turns tossing empty Heineken bottles into an engaging and rewarding experience by incorporating AI and gamification. Participants use the app to scan designated bins and confirm their Heineken disposal, unlocking a chance to win exciting prizes, including Champions League tickets, VIP passes to music festivals, and more.

The platform made its debut in Zaragoza, Spain, during The Champions Burger event in April, 2024, as part of a larger initiative. Participants accessed the web app on their phones, which guided them through the process of scanning local recycling bins and their empty Heineken bottles. The app's AI ensured accurate recognition, and upon verifying correct disposal, instantly revealed if participants had won a prize, making the recycling process both exciting and rewarding.

**Accurate Bin Recognition with Machine Learning:** 

We developed a robust Machine Learning model trained to identify various recycling bin types featured in the campaign. This involved extensive training with diverse bin imagery and rigorous on-site testing in Zaragoza to ensure real-world accuracy.




**Heineken Bottle Verification:** 

We leveraged 8th Wall's marker recognition technology. Unique markers placed on Heineken bottles enabled the app to verify the brand through the camera, ensuring only the correct bottles were counted.

We developed a user-friendly web app that utilizes AI and AR. 

**AI and Machine Learning:** The web app utilizes AI trained on various trash bins to ensure precise recognition. Participants use their phone cameras to scan and identify the correct recycling bins

**Augmented Reality:** An AR on the web takes the boundaries of the object scanned, calculates the bin’s position in the real world, and places a 3d neon banner on top of the bin




**Marker detection:** The Heineken bottle is identified using 8th Wall's marker-recognition technology. When users scan the bottle with the app, the camera detects specific markers on the bottle, triggering the AR experience.

**Hand release:** When the bottle is correctly disposed of, the empty hand is detected 

The intuitive app guides users through three straightforward steps:

1. **Recognize the Bin:** Scan the recycling bin to confirm its eligibility.
2. **Find the Bottle:** Aim the camera at the Heineken bottle for verification.
3. **Register an Empty Hand:** Dispose of the empty bottle, and the app detects the release, potentially revealing a prize win!

- **UI/UX Design:** We crafted intuitive and engaging user interfaces with smooth animations and transitions.
- **Front-end Development:** We built a user-friendly web app for a seamless experience.
- **Machine Learning Model Training:** We trained a custom ML model for precise bin recognition.
- **AR Development:** We utilized 8th Wall for marker detection, 3D object placement, and AR functionalities.
- **Technology Stack:** React, 8th Wall, PlayCanvas, MediaPipe Studio, Google Cloud Platform, Strapi

"Trash & Win" is set to launch at major events across Spain. It showcases how brands can leverage technology to meaningfully engage audiences, promoting a cleaner, greener future while delivering unforgettable experiences.

Heineken: Trash & Win

A mobile app using AI and AR to promote sustainability by rewarding users for recycling Heineken bottles.

Heineken

LePub

Commercial project

Advertising

FMCG

Projects

About

Capabilities

Process

We develop solutions in the area of Augmented Reality, Virtual Reality and Mixed Reality. These include mobile apps using ARKit and ARCore (iOS and Android respectively), as well as PC-based or standalone experiences using AR and VR goggles, like HTC Vive, Oculus Quest or HoloLens. We also specialise in social AR effects, for Facebook, Instagram and Snapchat.

Social platforms like Facebook, Instagram and Snapchat are just the right environment for Augmented Reality. They already have millions of users and they are intended to share and communicate. AR can extend the depth of communication through augmentations that are fun, expressive or even productive.

We also build completely bespoke, native AR apps that can offer much more robust experiences. One of the examples can be the JFK: Moonshot app that we helped develop.

Augmented Reality can also be accessed on the web. We use [Zappar](https://www.zappar.com/) and [8th Wall](https://www.8thwall.com/) technology to deliver marker-based as well as marker-less solutions online, without the need to install or download any app.

See one of our recent AR executions below:

AR / VR / MR

Social AR, Facebook, Instagram, Snapchat, iOS, Android, ARKit, ARCore, MS Hololens.

We are a trusted technology partner for startups, agencies and corporate clients. We build prototype-, MVP- and product-grade solutions in the area of web, mobile, Mixed Reality, Machine Learning and Blockchain.

AR / VR / MR | Capabilities | Le Polish Bureau

We are specialising in developing tailored, bespoke Machine Learning solutions for various businesses. In our products, we also incorporate state of the art AI components like Google Cloud Vision or Google Text To Speech.

Our Machine Learning know-how can be utilised in all sorts of domains - from creative-tech to gaming, messaging, human-machine collaborative tools, automatic problem solving, data insights computation as well as data acquisition, augmentation and processing.

Where there's data, there's knowledge. It's just a matter of using the right process to get to it.

Chatbots are a great way of automating communication. They can be text- or voice-based and they can live across pretty much any messaging platform. At Le Polish Bureau, we have experience in delivering solutions for:
- [Slack](https://slack.com/)
- [Facebook Messenger](https://www.messenger.com/)
- [Google Assistant](https://assistant.google.com/)
- [Amazon Alexa](https://www.amazon.com/echo)
- Web

Our natural language processing solutions are based on [Google Dialogflow](https://dialogflow.com/), providing highest level of semantic analysis, combined with support of multiple languages and deployment platforms.

A great example is OnePlus: Crackables, where a chatbot we developed was driving an online puzzle contest.

Sometimes you might have a specific need or an idea that you don't necessarily have all the needed data for. And gathering the data by your team will likely take ages. Probably literally.

This is where our Machine Learning data crowdsourcing solutions come to play.

We implemented this approach in order to analyze people's perception of the phenomenon of the northern lights. We developed a custom interactive questionnaire that allowed respondents to group the auroras by visual similarity. A different questionnaire was then asked to match audio to visuals in order to train the AI about "what an aurora could sound like".

Via data crowdsourcing we obtained over 10,000 data samples within just 24h!

There doesn't always have to be a clear scientific task to be solved with Machine Learning though. AI can be used for creative purposes too.

One of these is Neural Style Transfer. A use of AI to generate completely new visuals or audio based on reference style and a target piece to stylise.

Another interesting domain is reinforcement learning. It relies on the ability to run tens of thousands of parallel, sped-up simulations of a usually mechanical task that the AI is supposed to learn. For example, throwing balls to a basked. Without having to be taught explicitly how to do this, an AI can master such task quickly:

Another domain we specialise in is Machine Vision. We are using state-of-the-art implementations from Google to analyse the world around you. We can also implement custom Artificial Neural Networks that are specifically trained to perform a new detection task.

Regardless of what your challenge is, feel free to reach out. Our Machine Learning know-how is likely to apply.

See how we implemented Machine Learning solutions before:

AI / Machine Learning

Data services, custom models, crowdsourcing, cloud training, vision, language understanding, reinforcement learning.

We build cloud infrastructures for existing and for new projects. This includes RESTful APIs, CMSes, full back end infrastructures, game servers, real-time services, or server-side data processing, video rendering or Machine Learning.

When it comes to scalability and performance, we trust the leaders. All our solutions are based on [Google Cloud](https://cloud.google.com/). Back end infrastructures hosted on Google provide auto-scaling. This means that no matter how many visitors or users you have, the infrastructure will handle that. You don't have to worry about temporary spikes either. What's more, it results in cost optimisation as well, as the platform stops unused resources whenever there is downtime.

Our solutions involve producs like:
- Google App Engine
- Google Compute Engine
- Google Cloud Datastore
- Google Cloud SQL
- Google Cloud Storage

We also have a proven path to delivering state-of-the-art, customisable CMSes for your products developed on top of [Strapi](https://strapi.io/). Strapi is an open source CMS providing a modern architecture. It has recently [received massive funding](https://strapi.io/blog/announcing-strapi-4m-seed-funding-round) and is a product to stay with us for years. All our solutions are completely agnostic of the front end layer of your application. This means that if you ever wish to update or completely re-build the visual side of your project, you will never have to touch the data or the CMS in order to accommodate.

The data stored in our CMSes is available to your application through RESTful and GraphQL APIs.

We also develop custom real-time back ends tailored for games or collaborative online apps. They are based on WebRTC and WebSocket technologies, which allow your users to exchange multiple data packets per second, avoiding typical latency inevitable with HTTP requests.

A great example of that could be the back end powering Start Wars: Lightsaber Escape, which handled millions of players, each using two devices at the same time, where each pair of their devices was exchanging 20 data packets per second.

Cloud Computing

Ultra-scalable data and processing solutions on Google Cloud Platform. Real-time back ends, privacy-focused distributed Machine Learning and data crunching.

We are specialising in efficient cross-platform native apps development. Applications that require sophisticated, 3D visual content are developed in [Unity](https://unity.com/), while more traditional UI-heavy apps are done in [React Native](https://reactnative.dev/).

Unity is the leading Game Development platform, but it is also perfect for developing native mobile apps that provide 2D and 3D interactions. We have years long experience in delivering such apps across iOS and Android platforms, while ensuring a single, coherent stream of work. 

Such approach not only optimises cost and time, but also facilitates visual and functional consistency across platforms.

React Native is amazing for another reason. It allows to use the same technologies for native mobile apps development as are used for modern web. Contrary to old approaches that were packaging HTML5 websites into UI-less mobile apps, resulting in poor performance, React Native utilises actual native components of each operating system - iOS and Android respectively.

Regardless of the technology chosen, cross-platform mobile apps development ensures optimised cost, time and reduced risk of platform-specific bugs.

Mobile Apps

Rapid and efficient cross-platform development of the highest quality using React Native, from MVP to the final product.

We are specialising in professional, modern web development. This includes web apps, product websites, portfolio sites but also highly interactive, animated, 3D pieces of art.

Our team has years long experience working with WebGL, THREE.js and other 3D tools that are necessary to achieve stunning 3D online experiences.

PWAs are highly-optimised web apps that load quickly, support offline access (to an extent at least) and, for example, can be integrated into a mobile phone's home screen similarly to native apps. We develop them in React and we use Service Workers to provide the offline functionality.

We work with WebRTC and WebSocket technologies to implement massively-multiplayer online solutions that respond to user's input immediately.

An example can be the work we've done for Star Wars: Lightsaber Escape, where we allowed users to control a lightsaber with their mobile phones.

We design and develop entire projects, but we are also happy to work on a component basis, whenever your find a challenging aspect of your idea that needs dedicated help.

See an example web project we helped deliver below:

Web Development

Interactive web development using React and the latest tech. Server-side rendering, SEO and performance optimization.

Capabilities

AR / VR / MR

Overview

Social AR

Mobile AR

WebAR

Case Study

In collaboration with

Project