Tor support, use SeleniumBase instead of DrissionPage (#123)

Refactor: Improve Docker build, add Tor support, use SeleniumBase

- Overhauled Dockerfile:
    - Switched to python:3.10-slim base.
    - Implemented multi-stage builds (base, standard, tor).
    - Consolidated RUN layers for efficiency.
    - Added locale/timezone setup.
- Added Tor setup and iptables configuration in dedicated stage/script.
- Replaced DrissionPage with SeleniumBase for Cloudflare bypassing.
- Added Tor support via `docker-compose.tor.yml` and `tor.sh` script.
- Updated `docker-compose.yml` to build locally and changed default port
to 8083.
- Added `docker-compose.dev.yml` and `docker-compose.tor.dev.yml`.
- Updated `entrypoint.sh` for timezone and sudo usage.
- Added/Updated environment variables (`TZ`, `USING_TOR`, etc.).
- Improved `.dockerignore`.
- Updated `readme.md` to reflect port changes, build process, document
`TZ`, and add details about the new Tor variant.
This commit is contained in:
CaliBrain
2025-04-13 02:34:39 -04:00
committed by GitHub
parent e0e7470ac6
commit 57f15b4d95
18 changed files with 602 additions and 277 deletions
+20 -16
View File
@@ -1,12 +1,29 @@
{
"version": "0.2.0",
"configurations": [
{
"name": "Python Debugger: Current File",
"type": "debugpy",
"request": "launch",
"program": "${file}",
"console": "integratedTerminal",
"justMyCode": false,
"env": {
"INGEST_DIR": "/tmp/cwa-book-downloader",
"TEMP_DIR": "/tmp/cwa-book-downloader",
"LOG_LEVEL": "DEBUG",
"LOG_ROOT": "/tmp/cwa-book-downloader",
"ENABLE_LOGGING": "true",
"DOCKERMODE": "false",
"FLASK_DEBUG": "true"
},
},
{
"name": "Docker-compose Dev",
"type": "debugpy", // or "debugpy", Node, etc.
"type": "debugpy", // or "debugpy", Node, etc.
"request": "launch",
"program": "${workspaceFolder}/app.py",
"preLaunchTask": "docker-compose up (dev)", // Spin up dev containers
"preLaunchTask": "docker-compose up (dev)", // Spin up dev containers
"postDebugTask": "docker-compose down (dev)", // Optional: tear them down
"env": {
"INGEST_DIR": "/tmp/cwa-book-downloader"
@@ -17,25 +34,12 @@
"type": "debugpy",
"request": "launch",
"program": "${workspaceFolder}/app.py",
"preLaunchTask": "docker-compose up (prod)",
"preLaunchTask": "docker-compose up (prod)",
"postDebugTask": "docker-compose down (prod)",
"env": {
"INGEST_DIR": "/tmp/cwa-book-downloader"
},
},
{
"type": "debugpy",
"request": "launch",
"name": "Launch cwa-bd app.py",
"program": "${workspaceFolder}/app.py",
"env": {
"DOCKERMODE": "false",
"INGEST_DIR": "/tmp/cwa-book-downloader"
},
"presentation": {
"hidden": true
}
},
{
"type": "chrome",
"request": "launch",