Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ChangeDetection Playwright Chromium/Javascript broken #995

Open
1 of 2 tasks
b3nw opened this issue Dec 23, 2024 · 5 comments
Open
1 of 2 tasks

ChangeDetection Playwright Chromium/Javascript broken #995

b3nw opened this issue Dec 23, 2024 · 5 comments

Comments

@b3nw
Copy link

b3nw commented Dec 23, 2024 •
edited
Loading

✅ Have you read and understood the above guidelines?

yes

📜 What is the name of the script you are using?

ChangeDetection

📂 What was the exact command used to execute the script?

bash -c "$(wget -qLO - https://github.com/community-scripts/ProxmoxVE/raw/main/ct/changedetection.sh)"

📝 Provide a clear and concise description of the issue.

Clean install of ChangeDetection, using the Playwright Chromium/Javascript feature does not work.

image

image

⚙️ What settings are you using?

  • Default Settings
  • Advanced Settings

🖥️ Which Linux distribution are you using?

Debian 12

🔄 Steps to reproduce the issue.

Reproduction, install with default settings, access default site, edit https://changedetection.io/CHANGELOG.txt Requests to use Playwright Chromium/Javascript via 'ws://localhost:3000/chrome?launch={defaultViewport:{height:720,width:1280},headless:false,stealth:true}&blockAds=true' - get error:

❌ Paste the full error output (if available).

https://changedetection.io/CHANGELOG.txt Create a link to share watch config with others Using a Chrome browser Exception: BrowserContext.close: Target page, context or browser has been closed

🖼️ Additional context (optional).

journalct logs:

Dec 23 13:27:32 chg changedetection.io[15616]: 2024-12-23 13:27:32.523 | INFO     | changedetectionio.store:sync_to_json:384 - Saving JSON..
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.753Z browserless.io:server:trace  Handling inbound WebSocket request on "/chrome?launch={defaultViewpor>
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.756Z browserless.io:server:trace  Found matching WebSocket route handler "/chrome?(/)"
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.756Z browserless.io:server:trace  Authorizing WebSocket request to "http://localhost:3000/chrome?launch>
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.756Z browserless.io:server:trace  Validating route query-params with QUERY schema
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.795Z browserless.io:limiter:info  (Running: 0, Pending: 0) Adding to queue, max time allowed is 30,000ms
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.796Z browserless.io:limiter:info  (Running: 1, Pending: 0) Starting new job
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.798Z browserless.io:ChromeCDPWebSocketRoute:info ::1 Starting new ChromeCDP instance
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.799Z browserless.io:ChromeCDPWebSocketRoute:info ::1 ChromeCDP got open port 45883
Dec 23 13:27:32 chg browserless[15583]: 2024-12-23T19:27:32.799Z browserless.io:ChromeCDPWebSocketRoute:info ::1 {
Dec 23 13:27:32 chg browserless[15583]:   args: [
Dec 23 13:27:32 chg browserless[15583]:     '--remote-debugging-port=45883',
Dec 23 13:27:32 chg browserless[15583]:     '--no-sandbox',
Dec 23 13:27:32 chg browserless[15583]:     '--user-data-dir=/tmp/browserless-data-dirs/browserless-data-dir-df5c8678-2aa7-45c0-9de8-711e5a2220cf',
Dec 23 13:27:32 chg browserless[15583]:     '--load-extension=/opt/browserless/extensions/ublock',
Dec 23 13:27:32 chg browserless[15583]:     '--disable-extensions-except=/opt/browserless/extensions/ublock'
Dec 23 13:27:32 chg browserless[15583]:   ],
Dec 23 13:27:32 chg browserless[15583]:   executablePath: '/usr/bin/google-chrome-stable'
Dec 23 13:27:32 chg browserless[15583]: } Launching ChromeCDP Handler
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.375Z browserless.io:ChromeCDPWebSocketRoute:info ::1 ChromeCDP is running on ws://127.0.0.1:45883/devto>
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.375Z browserless.io:router:trace  Running found WebSocket handler.
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.375Z browserless.io:ChromeCDPWebSocketRoute:info ::1 Proxying http://localhost:3000/chrome?launch=%7B%7>
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.873Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 Setting up file:// protocol request rejection
Dec 23 13:27:33 chg changedetection.io[15616]: 2024-12-23 13:27:33.894 | DEBUG    | changedetectionio.blueprint.browser_steps.browser_steps:action_goto_url:92 - Ti>
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.898Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 GET: https://changedetection.io/favicon.ico
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.939Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 404: https://changedetection.io/favicon.ico
Dec 23 13:27:33 chg browserless[15583]: 2024-12-23T19:27:33.940Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 error: Failed to load resource: the server respon>
Dec 23 13:27:53 chg browserless[15583]: 2024-12-23T19:27:53.928Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 log: Scanning div,span,form,table,tbody,tr,td,a,p>
Dec 23 13:27:53 chg browserless[15583]: 2024-12-23T19:27:53.933Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 log: Scanning %ELEMENTS%
Dec 23 13:27:53 chg browserless[15583]: 2024-12-23T19:27:53.933Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 log: Returning 'Possibly in stock' - cant' find a>
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.798Z browserless.io:limiter:warn  Job has hit timeout after 30,003ms of activity.
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.798Z browserless.io:limiter:info  Calling timeout handler
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.798Z browserless.io:router:error  Websocket job has timedout, sending 429 response
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.802Z browserless.io:limiter:info  (Running: 0, Pending: 0) All jobs complete.
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.803Z browserless.io:router:trace  WebSocket Request handler has finished.
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.804Z browserless.io:browser-manager:info  0 Client(s) are currently connected, Keep-until: 0, force: fa>
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.804Z browserless.io:browser-manager:info  Closing browser session
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.804Z browserless.io:browser-manager:info  Deleting "/tmp/browserless-data-dirs/browserless-data-dir-df5>
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.804Z browserless.io:ChromeCDPWebSocketRoute:info ::1 Closing ChromeCDP process and all listeners
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.813Z browserless.io:server:trace  Websocket connection complete
Dec 23 13:28:02 chg browserless[15583]: 2024-12-23T19:28:02.818Z browserless.io:browser-manager:info  Deleting data directory "/tmp/browserless-data-dirs/browserle>
Dec 23 13:28:02 chg changedetection.io[15616]: 2024-12-23 13:28:02.857 | ERROR    | changedetectionio.update_worker:run:491 - Exception reached processing watch UU>
Dec 23 13:28:02 chg changedetection.io[15616]: 2024-12-23 13:28:02.857 | ERROR    | changedetectionio.update_worker:run:492 - BrowserContext.close: Target page, co>
Dec 23 13:28:02 chg changedetection.io[15616]: Playwright console: Watch URL: https://changedetection.io/CHANGELOG.txt error: Failed to load resource: the server r>
Dec 23 13:28:02 chg changedetection.io[15616]: Playwright console: Watch URL: https://changedetection.io/CHANGELOG.txt log: Scanning div,span,form,table,tbody,tr,t>
Dec 23 13:28:02 chg changedetection.io[15616]: Playwright console: Watch URL: https://changedetection.io/CHANGELOG.txt log: Scanning %ELEMENTS% [<JSHandle preview=>
Dec 23 13:28:02 chg changedetection.io[15616]: Playwright console: Watch URL: https://changedetection.io/CHANGELOG.txt log: Returning 'Possibly in stock' - cant' f>
Dec 23 13:28:02 chg changedetection.io[15616]: 2024-12-23 13:28:02.857 | DEBUG    | changedetectionio.update_worker:run:592 - Watch 579aa346-0e4f-493c-83f3-05ca177>
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET / HTTP/1.1" 200 8025 0.003181
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/styles/pure-min.css HTTP/1.1" 200 4224 0.001296
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/styles/styles.css?v=0.48.04 HTTP/1.1" 200 9704 0.001478
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/js/jquery-3.6.0.min.js HTTP/1.1" 200 31406 0.003246
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/images/Google-Chrome-icon.png HTTP/1.1" 304 328 0.000531
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/images/Generic_Feed-icon.svg HTTP/1.1" 200 799 0.000580
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/images/spread-white.svg HTTP/1.1" 200 933 0.000602
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/images/bell-off.svg HTTP/1.1" 200 1095 0.000628
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/images/pause.svg HTTP/1.1" 200 1421 0.000609
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/images/spread.svg HTTP/1.1" 200 899 0.000597
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/js/csrf.js HTTP/1.1" 304 310 0.000497
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/js/watch-overview.js HTTP/1.1" 200 1216 0.000646
Dec 23 13:28:15 chg changedetection.io[15616]: 192.168.2.216 - - [23/Dec/2024 13:28:15] "GET /static/js/toggle-theme.js HTTP/1.1" 200 1192 0.000600
Dec 23 13:28:32 chg changedetection.io[15616]: 2024-12-23 13:28:32.552 | INFO     | changedetectionio.store:sync_to_json:384 - Saving JSON..```
@MickLesk
Copy link
Member

Can you Check again?

@b3nw
Copy link
Author

b3nw commented Dec 27, 2024

@MickLesk I rebuilt this again today, same exact result, what was changed? I didn't see anything in the commits.

@b3nw
Copy link
Author

b3nw commented Dec 27, 2024

I was able to fix this by reverting the browserless back to v1 following discussion from tteck/Proxmox#2262 (comment)

but the clean install should in theroy work?

@damienDar
Copy link

starting with a clean container I'm facing timeout errors according to the logs:

Dec 31 08:32:39 changedetection browserless[18441]: 2024-12-31T07:32:39.965Z browserless.io:ChromeCDPWebSocketRoute:info ::1 Starting new ChromeCDP instance
Dec 31 08:32:39 changedetection browserless[18441]: 2024-12-31T07:32:39.967Z browserless.io:ChromeCDPWebSocketRoute:info ::1 ChromeCDP got open port 33351
Dec 31 08:32:39 changedetection browserless[18441]: 2024-12-31T07:32:39.967Z browserless.io:ChromeCDPWebSocketRoute:info ::1 {
Dec 31 08:32:39 changedetection browserless[18441]:   args: [
Dec 31 08:32:39 changedetection browserless[18441]:     '--remote-debugging-port=33351',
Dec 31 08:32:39 changedetection browserless[18441]:     '--no-sandbox',
Dec 31 08:32:39 changedetection browserless[18441]:     '--user-data-dir=/tmp/browserless-data-dirs/browserless-data-dir-9e67f05d-a396-463e-b033-6a51cb912829',
Dec 31 08:32:39 changedetection browserless[18441]:     '--load-extension=/opt/browserless/extensions/ublock',
Dec 31 08:32:39 changedetection browserless[18441]:     '--disable-extensions-except=/opt/browserless/extensions/ublock'
Dec 31 08:32:39 changedetection browserless[18441]:   ],
Dec 31 08:32:39 changedetection browserless[18441]:   executablePath: '/usr/bin/google-chrome-stable'
Dec 31 08:32:39 changedetection browserless[18441]: } Launching ChromeCDP Handler
Dec 31 08:32:41 changedetection browserless[18441]: 2024-12-31T07:32:41.032Z browserless.io:ChromeCDPWebSocketRoute:info ::1 ChromeCDP is running on ws://127.0.0.1:33351/devtools/browser/01d9a805-41af-43b8-926b-3baecd90ed67
Dec 31 08:32:41 changedetection browserless[18441]: 2024-12-31T07:32:41.035Z browserless.io:router:trace  Running found WebSocket handler.
Dec 31 08:32:41 changedetection browserless[18441]: 2024-12-31T07:32:41.035Z browserless.io:ChromeCDPWebSocketRoute:info ::1 Proxying http://localhost:3000/chrome?launch=%7B%7D&blockAds=true to ChromeCDP ws://127.0.0.1:33351/devtools/browser/01d9a805-41af-43b8-926b-3baecd90ed67
Dec 31 08:32:41 changedetection browserless[18441]: 2024-12-31T07:32:41.478Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 Setting up file:// protocol request rejection
Dec 31 08:32:41 changedetection browserless[18441]: 2024-12-31T07:32:41.516Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 GET: https://changedetection.io/CHANGELOG.txt
Dec 31 08:32:42 changedetection browserless[18441]: 2024-12-31T07:32:42.021Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 200: https://changedetection.io/CHANGELOG.txt
Dec 31 08:32:42 changedetection browserless[18441]: 2024-12-31T07:32:42.029Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 Navigation to https://changedetection.io/CHANGELOG.txt
Dec 31 08:32:42 changedetection browserless[18441]: 2024-12-31T07:32:42.112Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 GET: https://changedetection.io/favicon.ico
Dec 31 08:32:42 changedetection changedetection.io[18476]: 2024-12-31 08:32:42.113 | DEBUG    | changedetectionio.blueprint.browser_steps.browser_steps:action_goto_url:92 - Time to goto URL 0.64s
Dec 31 08:32:42 changedetection browserless[18441]: 2024-12-31T07:32:42.241Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 404: https://changedetection.io/favicon.ico
Dec 31 08:32:42 changedetection browserless[18441]: 2024-12-31T07:32:42.241Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 error: Failed to load resource: the server responded with a status of 404 ()
Dec 31 08:32:56 changedetection browserless[18441]: 2024-12-31T07:32:56.241Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 log: Scanning div,span,form,table,tbody,tr,td,a,p,ul,li,h1,h2,h3,h4,header,footer,section,article,aside,details,main,nav,section,summary,button
Dec 31 08:32:56 changedetection browserless[18441]: 2024-12-31T07:32:56.271Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 log: Scanning %ELEMENTS%
Dec 31 08:32:56 changedetection browserless[18441]: 2024-12-31T07:32:56.285Z browserless.io:ChromeCDPWebSocketRoute:trace ::1 log: Returning 'Possibly in stock' - cant' find any useful matching text
Dec 31 08:33:09 changedetection browserless[18441]: 2024-12-31T07:33:09.974Z browserless.io:limiter:warn  Job has hit timeout after 30,010ms of activity.

@emillassen
Copy link

I'm having the same timeout error. I tried a complete reinstall of the LXC, as well as installing browserless manually, with the same result.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@emillassen @b3nw @MickLesk @damienDar