I Built an Open-Source Firebase Analytics Alternative Because I Hit 1M Events/Day Once Too Many

About this episode

    This story was originally published on HackerNoon at: <a href="https://hackernoon.com/i-built-an-open-source-firebase-analytics-alternative-because-i-hit-1m-eventsday-once-too-many">https://hackernoon.com/i-built-an-open-source-firebase-analytics-alternative-because-i-hit-1m-eventsday-once-too-many</a>.
        <br> After hitting Firebase Analytics 1M events/day cap during a mobile game softlaunch, I built an open-source self-hosted analytics pipeline. Here's how. <br>
        Check more stories related to data-science at: <a href="https://hackernoon.com/c/data-science">https://hackernoon.com/c/data-science</a>.
        You can also check exclusive content about <a href="https://hackernoon.com/tagged/data-engineering">#data-engineering</a>, <a href="https://hackernoon.com/tagged/game-development">#game-development</a>, <a href="https://hackernoon.com/tagged/analytics-pipeline">#analytics-pipeline</a>, <a href="https://hackernoon.com/tagged/self-hosted-analytics">#self-hosted-analytics</a>, <a href="https://hackernoon.com/tagged/event-streaming">#event-streaming</a>, <a href="https://hackernoon.com/tagged/event-tracking">#event-tracking</a>, <a href="https://hackernoon.com/tagged/product-analytics">#product-analytics</a>, <a href="https://hackernoon.com/tagged/firebase-analytics">#firebase-analytics</a>,  and more.
        <br>
        <br>
        This story was written by: <a href="https://hackernoon.com/u/rawbbit">@rawbbit</a>. Learn more about this writer by checking <a href="https://hackernoon.com/about/rawbbit">@rawbbit's</a> about page,
        and for more stories, please visit <a href="https://hackernoon.com">hackernoon.com</a>.

            <br>
            <br>
            A few years ago I was the data engineer on a mobile game soft launch when Firebase Analytics quietly started dropping events past its 1M/day cap. We didn't catch it for days. That experience pushed me to build Rawbbit — an open-source, Apache 2.0, self-hosted analytics pipeline that lands raw events as Parquet in your own object storage. This is the story of why hosted analytics fails at scale, why I chose NATS + Parquet + BigQuery external tables, and what I deliberately left out.
    </p>