I have built a free and open source A/B tests analysis tool called ExpLab and would love to share it with anyone interested, feel free to fork, change and use it however you want.
I have been in the experimentation and A/B testing space for a bit of time and there are two realities I have seen in the field: Either you pay a lot of money for a tool like Amplitude, Statsig, Eppo, Optimizely etc. or you need to rely on a spaghetti of python notebooks, google sheets that aren't replicable or centralized and lacking some crucial best-practices and diagnostic checks.
This is not a feature flagging tool, it's an analysis tool that relies on having the experiment data in a database. Schema requirements are in the Documentation section of the tool.
I currently have support for Postgres and MySql but I am working on extending it to Snowflake and Bigquery.
Note: I am not a SWE by trade so I relied on LLMs (Codex+Gemini Pro) to build this but the stats engine has been tested extensively to ensure the results are sound and correct.
Let me know what you think of this.
ExpLab - getexplab.com
I have built a free and open source A/B tests analysis tool called ExpLab and would love to share it with anyone interested, feel free to fork, change and use it however you want.
I have been in the experimentation and A/B testing space for a bit of time and there are two realities I have seen in the field: Either you pay a lot of money for a tool like Amplitude, Statsig, Eppo, Optimizely etc. or you need to rely on a spaghetti of python notebooks, google sheets that aren't replicable or centralized and lacking some crucial best-practices and diagnostic checks.
This is not a feature flagging tool, it's an analysis tool that relies on having the experiment data in a database. Schema requirements are in the Documentation section of the tool.
I currently have support for Postgres and MySql but I am working on extending it to Snowflake and Bigquery.
Note: I am not a SWE by trade so I relied on LLMs (Codex+Gemini Pro) to build this but the stats engine has been tested extensively to ensure the results are sound and correct.
Let me know what you think of this. ExpLab - getexplab.com