Waterbear: An Augmented Reality Book Platform That Brings Printed Pages to Life in Three Languages
How NipsApp Game Studios built one AR reader app, a web admin panel and a cloud backend so a publisher can add 3D scenes and narration to printed books in Korean, English and Portuguese, with no app update for each new book.
Project Summary
Waterbear is an augmented reality (AR) book platform built by NipsApp Game Studios. Readers point a phone at a page of a printed book, and a 3D scene appears on the paper with animation and spoken narration. One app serves every book the publisher releases. The publisher adds new books, pages, 3D models and narration from a web admin panel, and they reach readers within minutes, without a new app version.
The first three titles are a book series called Rock, Paper and Scissors, printed in B5 format in Korean, English and Portuguese editions. Each book has five AR scenes, fifteen in total.
Watch the Demo
The video shows a reader opening a book in the Waterbear app, scanning an AR page and seeing the 3D scene and narration, followed by an editor adding a new scene in the admin panel.
The Challenge
The client is an author working with a publisher on a new book series. They wanted each printed book to include AR scenes that readers can see through their phone, and they had five clear needs:
- One app for every book. A separate app for each title would cost too much and confuse readers.
- Publish without developers. The publishing team must add future books on their own, with 3D models from any artist.
- Three language editions. The same series is printed in Korean, English and Portuguese, with narration in each language.
- AR before print. The books were not printed yet. The AR pages had to be designed and tested first, so the printed pages are guaranteed to scan well.
- Work offline. Readers should download a book once and read it anywhere, even with no internet.
A common problem with AR books is pages the phone cannot recognise. Plain pages, pages with little contrast and pages with repeating patterns all scan poorly. The platform needed a way to catch these problems before a book goes to print.
What NipsApp Built
NipsApp Game Studios built three connected parts: the Waterbear reader app for iOS and Android, a web admin panel for the publishing team, and a cloud backend that processes and delivers every book.
One reader app that plays every book
The Waterbear app is a player, not a single book. It downloads the list of published books, lets the reader choose one, and builds the page recognition library on the phone from that book's pages. When the camera sees an AR page, the matching 3D scene appears on the paper at the correct size, follows the page as the reader moves, and plays its animation and narration.
A web admin panel built for editors
The publishing team creates books, uploads page images, uploads 3D models and narration, and places each model on its page with sliders and a live 3D preview. The preview shows the page at its real printed size, so a model that looks right in the browser looks the same on the phone. A "fit to page" button sizes any model to the page in one click.
A page quality score before printing
Every page image gets a tracking score from 0 to 1 the moment it is uploaded, with a Good, Fair or Poor badge and plain advice, such as "detail is concentrated in one area" or "repeating patterns detected". The same scoring runs in the browser and on the server, so the editor sees the result instantly and the stored score matches it.
Generated AR page designs
The client wanted text-free AR pages that are identical in all three language editions. NipsApp built a generator that creates a unique low-poly pattern for each scene in the Waterbear colours of mint, white and silver, with a scan badge in the corner. Each design is scored on the spot and exported as a print file with 3 mm bleed and as a 300 DPI image. Because every page is different, the app never confuses two scenes.
Narration in three languages on one page
Each AR scene has one narration track per edition language. The page and the 3D scene are shared, and the reader hears the narration of the edition they own. The reader picks the edition once per book. The admin panel warns before publishing if any scene is missing a translation.
Offline reading
Readers download a book once, including only their edition's narration, and then read with no internet. Files shared between books are downloaded only once, and a book only counts as downloaded after every file has arrived, so an interrupted download never leaves a broken book.
Safe, versioned publishing
Editors work on a draft that readers never see. Publishing checks the book for problems, then freezes it as a numbered version. Any earlier version can be restored with one click. Readers who already downloaded a book keep their offline copy, and receive the new version the next time they open it with a connection.
Asset library, team roles and analytics
Every 3D model, sound and video goes into a shared library and can be reused in any book. Team members have Admin, Editor or Viewer roles, with optional two-step sign-in. The dashboard shows daily active readers, page scans, downloads, the most scanned scenes and readers by country, without storing personal data about readers.
A cloud backend in Seoul
The backend runs on Google Cloud through Firebase in the Seoul region, close to Korean readers. It converts uploaded models from GLB, glTF, FBX and OBJ into optimised files for phones, normalises narration volume, re-encodes video, runs a nightly health check, and saves a daily backup.
How Waterbear Works
For readers
- Install the free Waterbear app.
- Choose a book and the edition you own: Korean, English or Portuguese.
- Download the book once.
- Point the camera at an AR page.
- Watch the 3D scene on the page, listen to the narration, then tap, pinch or turn the model.
For the publisher
- Create a book in the admin panel and choose its editions.
- Generate or upload each AR page and check its tracking score.
- Upload the 3D model and the narration for each language.
- Place the model on the page in the live 3D preview.
- Click Publish. The book appears in the app within minutes.
Results From Testing
These results come from NipsApp's automated tests and content checks on the finished platform, before launch.
- A page image was uploaded, processed and scored in about 4 seconds.
- A two-scene sample book downloaded at about 0.6 MB per reader, including one language's narration.
- The reader app's own download and loading code passed all 20 checks against a published sample book in all three editions, including correct model size and rotation on the page.
- Over 75 automated tests cover the backend, the security rules, the admin panel and the reader app.
Screenshots
Technology Used
| Part | Technology | Why |
|---|---|---|
| Reader app | Unity 6, AR Foundation 6 with ARKit (iOS) and ARCore (Android) | One codebase for iPhone and Android with native image tracking |
| 3D loading | glTFast, GLB models | Fast runtime loading of models downloaded after install |
| Page recognition | Runtime image library built from downloaded pages | New books become scannable without an app update |
| Admin panel | React, Vite, Tailwind CSS, three.js | Runs in any browser, with a live 3D preview |
| Backend | Firebase: Firestore, Cloud Storage, Cloud Functions, Authentication | Scales automatically, hosted in the Seoul region |
| Media processing | Model optimisation, FBX and OBJ conversion, audio loudness normalisation, H.264 video | Every upload is made phone-ready automatically |
| Security | Role-based access rules, optional two-step sign-in, anonymous reader accounts | Editors control content; readers need no account |
Who This Kind of Platform Is For
The same platform suits any organisation that prints books or cards and wants them to come alive on a phone:
- Publishers and authors of children's books, novels, biographies and comics
- Educational publishers making textbooks with 3D models of science, history or architecture
- Museums, galleries and exhibitions with printed guides and catalogues
- Brands with product packaging, brochures and printed marketing
Frequently Asked Questions
What is Waterbear?
Waterbear is an augmented reality book app and publishing platform built by NipsApp Game Studios. Readers scan pages of printed books with a phone and see 3D scenes with narration on the page. Publishers add new books from a web admin panel without updating the app.
What is an AR book app?
An AR book app is a phone or tablet app that recognises the pages of a printed book through the camera and shows digital content on top of them, such as 3D models, animation, sound or video. The printed book stays the main experience, and the app adds a layer readers can see and hear.
How does AR work with a printed book?
The app holds an image of each AR page and its printed size. When the camera sees a matching page, AR Foundation tracks the page's position, and the app places the 3D scene on it at the correct scale. The scene stays attached to the paper as the reader moves the phone.
Can a publisher add new books without updating the app?
Yes. Books, pages, models and narration are uploaded in the admin panel and published to the cloud. The app downloads them when a reader opens the book, and builds the page recognition library on the phone at that moment, so no new app version is needed.
Can one AR page work for several language editions?
Yes, if the AR page has no text and looks the same in every edition. Waterbear stores one page image and one 3D scene per AR page, plus a separate narration track for each language. The reader chooses their edition once, and hears the narration in that language.
Does the AR book app work offline?
Yes. After a reader downloads a book once, it opens and scans with no internet connection. Only the narration for the reader's edition is downloaded, which keeps the download small.
Which 3D file formats does the platform accept?
The admin panel accepts GLB, glTF, FBX and OBJ files. The backend converts every model to an optimised GLB for phones, limits textures to 1024 pixels, and rejects models above 30,000 triangles with a clear message for the artist.
Should AR be added before or after a book is printed?
Before is best. When the AR pages are designed and scored first, the printed pages are guaranteed to scan well. AR can also be added to books that are already printed, by uploading the final page images, but weak pages cannot be fixed after printing.
How long does it take to build an AR book platform?
The Waterbear plan is 14 weeks from kickoff to store launch. That covers the reader app, the admin panel, the backend, three books with fifteen AR scenes, testing on phones, store submission and team training.
Can NipsApp build an AR book app for my publishing house?
Yes. NipsApp Game Studios builds AR apps for books, education and marketing on iOS and Android, including the 3D models, animation and the admin tools your team needs to publish on its own.
Want your printed books to come alive?
NipsApp Game Studios designs and builds AR book apps with 3D scenes, narration in your readers' languages and an admin panel your team can use without developers. Tell us about your books and we will reply within one business day.
Contact usNipsApp Game Studios, [email protected]
View on Apple Maps 
