Maxun v0.0.7 | Dark Theme, Arm64 Docker Support, Restart Recording Session +++

What's New

🌙 Dark Theme

Toggle between light and dark mode!

🔄 Restart Recording Session

Want to undo all captures in the current recording session? Now, you can simply "Restart Recording" instead of discarding and creating a new recording session.

⚙️ Arm64 Docker Support

Highly requested by the community. Maxun can now be run and deployed on ARM-based environments such as Raspberry Pi, AWS Graviton, and Apple M-series chips.

🤩 Better Pagination Selection

We have improved the reliability of pagination selection, allowing a robot to extract 50,000+ rows of data in one run.

What's Changed

• feat: latest compose changes for upgrade by @amhsirak in #325
• feat: dark theme support by @AmitChauhan63390 in #148
• feat: avoid virtual scroll in proxy info ui by @amhsirak in #326
• chore: add docs to readme by @amhsirak in #328
• feat: toggle mode tooltip by @amhsirak in #329
• feat: link docs to user menu by @amhsirak in #330
• feat: match toggle mode icon color in dark mode to theme by @amhsirak in #332
• feat(refactor): move away from atomic design pattern by @amhsirak in #333
• feat: add language option by @amhsirak in #301
• feat: routing by @amhsirak in #336
• feat: set output as default tab for run by @amhsirak in #337
• feat: redirect to robot integrate route after google oauth by @amhsirak in #338
• feat: limit output preview data to 5 by @RohitR311 in #334
• feat(ui): position robot settings modal by @ninja-programmer in #342
• feat: add message to display list being empty by @RohitR311 in #300
• feat: reset remote browser recording state by @RohitR311 in #314
• feat: much more reliable pagination by @RohitR311 in #331
• feat: link docs to restart menu by @amhsirak in #343
• feat: recorder save panel UI consistency by @amhsirak in #344
• chore: remove selector console logs by @amhsirak in #345
• chore: pre-release 0.0.7 by @amhsirak in #346
• feat: arm64 architecture support by @RohitR311 in #341
• feat: docker setup upgrade instructions by @amhsirak in #347

New Contributors

• @ninja-programmer made their first contribution in #342

Full Changelog: v0.0.6...v0.0.7

Maxun v0.0.6 | 50%+ reduction in memory usage, IFrame & Shadow DOM extraction

What's New

Better Extraction 🕷️

Support for iframes and shadow dom!

Recording Browser Optimization 🎉

1. Overall memory usage improved by ~1.56x (56% reduction in memory usage)
2. Massive improvements for External and Array Buffers (~90%+ reductions).
3. Heap memory usage reduced by ~1.3 GB, which is nearly 30% less memory usage for the heap!

What's Changed

• fix: browser window english language by @RohitR311 in #287
• fix: preserve previous labels steps before adding list step by @RohitR311 in #288
• chore: code cleanup by @amhsirak in #289
• fix: i18n logs by @amhsirak in #290
• feat: enhance edit robot ui by @amhsirak in #292
• chore: login translation switcher by @amhsirak in #293
• fix: move handleSave onClick to save button for edit robot by @amhsirak in #294
• fix: avoid reload on duplicate robot cancel by @amhsirak in #295
• chore: add refs in urls by @naveenpan09 in #297
• feat: better parsing of tables by @RohitR311 in #291
• feat: work email translations by @amhsirak in #298
• feat: add delete functionality for text and list steps by @RohitR311 in #299
• feat: navigate across capture list stages by @RohitR311 in #303
• feat: confirmation UI for pagination & limit steps by @amhsirak in #304
• fix: avoid ui shift on api key reveal by @amhsirak in #307
• chore: cleanup src/api by @amhsirak in #309
• fix: twitter typo by @amhsirak in #310
• feat: notify on schedule delete by @amhsirak in #308
• docs: update website to maxun.dev by @amhsirak in #312
• fix: translation changes by @RohitR311 in #316
• fix: update custom limit if value >= 1 by @RohitR311 in #315
• feat: shadow dom selection by @amhsirak in #296
• feat: support iframe extraction by @amhsirak in #275
• feat: compatibility check for shadowDOM and iframe scraping by @RohitR311 in #320
• feat: recorder performance improvements by @amhsirak in #313
• feat: handle selection for input & select tags by @amhsirak in #322

Full Changelog: v0.0.5...v0.0.6

Maxun v0.0.5 Release 🎉 | Input Handlers, Internationalization Support

Hey Everybody! v0.0.5 introduces input handlers and i18n support! 🎉

⚙️ Input Handlers Available

1. Date Fields
2. Dropdowns
3. Range
4. Time
5. Checkboxes
6. Radios

🔤 Internationalization Support (i18n)

1. English
2. Chinese
3. Japanese
4. German
5. Spanish

What's Changed

• chore: remove local note by @amhsirak in #251
• feat: remove fe be mounts by @amhsirak in #256
• feat: add check for selector visibility, revert domcontentloaded to networkidle state by @RohitR311 in #257
• fix: scrapeList empty output preview by @RohitR311 in #264
• feat: browser improvements by @amhsirak in #259
• feat: selection revamp by @amhsirak in #266
• fix: skip click action if selector not visible by @RohitR311 in #267
• feat: add functionality to handle user inputs (part 1) by @RohitR311 in #268
• feat: selection for <select> tag by @amhsirak in #272
• feat: selection for <input> tags by @amhsirak in #273
• feat: clearer upgrade instructions by @amhsirak in #274
• feat: handle datetime-local <input> tag by @amhsirak in #276
• feat: auto logout by @amhsirak in #277
• chore: format concurreny.ts in maxun-core by @richardzen in #280
• chore: cleanup some code by @richardzen in #279
• feat(.github): delete duplicate directory by @richardzen in #278
• Update README.md by @HCSS-StratBase in #258
• feat: internationalization (i18n) by @AmitChauhan63390 in #242
• feat: add output preview data reset functionality by @RohitR311 in #282
• feat: avoid crash due to adblocker by @amhsirak in #284
• chore: release v0.0.5 by @amhsirak in #261

New Contributors

• @richardzen made their first contribution in #280
• @HCSS-StratBase made their first contribution in #258

Full Changelog: v0.0.4...v0.0.5

Maxun v0.0.4 Release 🎉 | Extract Behind Login, Product Updates

Hey Everybody! v0.0.4 introduces two new features

Extract Behind Login

Introducing extract behind login in Maxun!🔐
With extract behind login, you can scrape data behind logins using username and password. Cookie sessions coming soon! 🍪
👉 Watch this video to know more: https://www.youtube.com/watch?v=_-n6OFQI_x4

Product Updates

Upgrading self-hosted open-source software is hard. To make it easier, we are bringing product upgrades. You will automatically be notified on your dashboard when a new release is available! ⚡

What's Changed

• fix: use window.location.origin as baseUrl for scrapeList by @amhsirak in #228
• feat: product updates by @amhsirak in #233
• feat: extract behind login by @RohitR311 in #229
• feat: rect dom depth information by @amhsirak in #235
• feat: apply conditional visual containment by @amhsirak in #238
• fix: include visual containment for capture list selection by @amhsirak in #241
• fix: handle context destroyed and frame navigation by @RohitR311 in #243
• feat: emit setGetList false socket event in pagination mode by @amhsirak in #244
• feat: conditional selection by @amhsirak in #246
• feat: node version in docker images by @amhsirak in #247
• fix: explicitly set easylist url by @amhsirak in #248
• feat: website to api improvements (swagger) by @amhsirak in #249
• chore: release v0.0.4 by @amhsirak in #225
• chore: use updated playwright image by @amhsirak in #250

Full Changelog: hotfix-0.0.3...v0.0.4

Maxun Hotfix Release | hotfix-0.0.3

The hotfix is for creating robots that require pagination. v0.0.3 accidentally broke it. Please upgrade to this release, else your robots with pagination will fail.

Steps To Upgrade Maxun Version

1. go to project directory
2. run git pull origin master
3. if using docker, perform step 1 & 2 then:

• run docker-compose down
• run docker-compose pull
• run docker-compose up -d

Full Changelog: v0.0.3...hotfix-0.0.3

Maxun OSS v0.0.3 Release 🎉| Bug Fixes & Enhancements

Maxun v0.0.3 introduces new environment variables for dynamic ports for flexibility in Docker setups, especially when running on virtual machines (VMs) or in multi-instance scenarios.

New Environment Variables

1. PUBLIC_URL - URL to run frontend on
2. VITE_PUBLIC_URL - URL used by backend to connect to frontend
3. BACKEND_PORT - Port to run backend on. Needed for Docker setup
4. FRONTEND_PORT - Port to run frontend on. Needed for Docker setup
5. MINIO_CONSOLE_PORT - Port number for MinIO WebUI service. Needed for Docker setup

• See all the updated environment variables here: https://github.com/getmaxun/maxun?tab=readme-ov-file#environment-variables
• Update your .env files by checking out the sample here: https://github.com/getmaxun/maxun/blob/master/ENVEXAMPLE

Thank you ❤️
Team Maxun

Steps To Upgrade Maxun Version

1. go to project directory
2. run git pull origin master
3. if using docker, perform step 1 & 2 then:

• run docker-compose down
• run docker-compose pull
• run docker-compose up -d

What's Changed

• fix: min edit robot limit set to be 1 by @RohitR311 in #203
• feat: improve logging by @amhsirak in #213
• feat: remove beta tag by @amhsirak in #214
• feat: better notifications by @amhsirak in #212
• feat: center progress by @amhsirak in #215
• feat: rearrange robot options by @amhsirak in #217
• feat: enhance output preview load by @amhsirak in #219
• docs: minor changes in readme by @KaranRudra311 in #221
• feat: dynamic public url by @amhsirak in #223
• chore: add .github files by @KaranRudra311 in #222
• feat: handle browser link navigation by @RohitR311 in #208
• fix: emit socket urlChanged on frame navigation by @amhsirak in #224
• chore: release v0.0.3 by @amhsirak in #209

New Contributors

• @KaranRudra311 made their first contribution in #221

Full Changelog: v0.0.2...v0.0.3

Maxun OSS v0.0.2 Release 🎉 | Robot Duplication, Search, CSV Export, Stealth Support, Docker Image ++

Hey Everybody! v0.0.2 comes with a lot of amazing things, the most fun being "Robot Duplication". With robot duplication, you can scrape similar structural pages quicker, without training a robot again.

👉 Watch this video to know more: https://www.youtube.com/watch?v=fdW8VPcAsN8

What's Changed

• chore: add example file for environment variables by @amhsirak in #112
• fix: env default backend url by @amhsirak in #114
• feat: apply public-read policy to minio bucket by @amhsirak in #124
• fix: browser recorder tab name by @RohitR311 in #123
• chore: release public v0.0.1 by @amhsirak in #125
• chore: remove debug print for req.body by @joshua111000 in #130
• enhancement: discord icon placement by @amhsirak in #134
• fix: robot settings' text field label & text overlap by @amhsirak in #135
• feat: improve gsheet integration ui by @amhsirak in #136
• feat: rename API Docs to Website To API by @amhsirak in #146
• feat: handle jwt token expiration by @amhsirak in #153
• fix: google oauth redirect by @RohitR311 in #142
• feat: generate encryption key if not provided or invalid by @amhsirak in #149
• fix: gracefully handle jwt token decoding by @amhsirak in #156
• feat: export to csv by @AmitChauhan63390 in #163
• fix: download as csv button style by @RohitR311 in #166
• feat: show notification after successful google authentication by @RohitR311 in #165
• chore: env sample values by @naveenpan09 in #172
• fix: remote browser rendering by @RohitR311 in #170
• chore: minio success message by @amhsirak in #177
• feat: edit robot by @amhsirak in #179
• feat: robot duplication by @RohitR311 in #181
• feat: show notification on robot delete with existing runs by @AmitChauhan63390 in #176
• feat: register and login forms redesign by @AmitChauhan63390 in #178
• chore: console cleanup by @amhsirak in #185
• feat: notify on successful google sheet selection by @amhsirak in #186
• feat: display robot limit in robot settings by @RohitR311 in #191
• feat: better nested elements capture in capture list by @amhsirak in #187
• feat: search robots & runs by @AmitChauhan63390 in #190
• feat: byop instructions for authenticated proxies by @amhsirak in #196
• feat: ui enhancements by @amhsirak in #197
• feat: bring back oss steath mode 🥷 by @amhsirak in #198
• feat: publish docker image by @amhsirak in #173
• feat: add notification timeout by @RohitR311 in #199
• chore: release v0.0.2 by @amhsirak in #147
• feat: handle relative src & href paths in scrapeList & scrapeSchema by @amhsirak in #201
• feat: handle relative src & href paths in scrapeList & scrapeSchema (missing in v0.0.2) by @amhsirak in #202

New Contributors

• @joshua111000 made their first contribution in #130
• @AmitChauhan63390 made their first contribution in #163

Full Changelog: v0.0.01...v0.0.2

v0.0.01

Maxun OSS v0.0.1 Release 🎉

Hey Everybody! We've fixed a lot of bugs to ensure you can scrape data much more easily 😄

👉 Here is a highly requested introductory demo video : https://www.youtube.com/watch?v=ZXGQEwQN7yI&t=2s

Thank you for your support and patience ❤️

What's Changed

• chore: pre-release v.0.0.1 by @amhsirak in #88
• fix: remove dimension picking from browser dimensions by @HarshGID100 in #92
• feat: local docker setup by @amhsirak in #93
• docs: docker compose & backend env variables by @amhsirak in #105
• chore: license by @amhsirak in #108
• chore: update concurrency.ts by @eltociear in #104
• chore: add example file for environment variables by @amhsirak in #112
• fix: env default backend url by @amhsirak in #114
• fix: logo path fixed by @RohitR311 in #116
• feat: mount fe & be docker volumes by @amhsirak in #120
• fix: handle undefined backend url in local setup by @amhsirak in #121
• feat: handle capture list initial capture stage confirmation by @amhsirak in #122
• fix: browser recorder tab name by @RohitR311 in #123
• feat: apply public-read policy to minio bucket by @amhsirak in #124

New Contributors

• @naveenpan09 made their first contribution in #33
• @HarshGID100 made their first contribution in #92
• @eltociear made their first contribution in #104
• @RohitR311 made their first contribution in #116

Full Changelog: https://github.com/getmaxun/maxun/commits/v0.0.01