2026-08-25 08:01:19 [scrapy.utils.log] INFO: Scrapy 2.8.0 started (bot: modularspiders) 2026-08-25 08:01:19 [scrapy.utils.log] INFO: Versions: lxml 4.9.2.0, libxml2 2.9.14, cssselect 1.2.0, parsel 1.7.0, w3lib 2.1.1, Twisted 22.10.0, Python 3.10.15 (main, Oct 19 2024, 04:00:28) [GCC 12.2.0], pyOpenSSL 23.1.1 (OpenSSL 3.1.0 14 Mar 2023), cryptography 40.0.1, Platform Linux-5.10.0-21-amd64-x86_64-with-glibc2.36 2026-08-25 08:01:19 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'modularspiders', 'CLOSESPIDER_TIMEOUT': 3600, 'CONCURRENT_REQUESTS': 2, 'LOG_FILE': 'logs/default/cymru-beats/009b462aa05b11f18d4f0242ac11000d.log', 'NEWSPIDER_MODULE': 'modularspiders.spiders', 'RANDOMIZE_DOWNLOAD_DELAY': False, 'ROBOTSTXT_OBEY': True, 'SPIDER_MODULES': ['modularspiders.spiders'], 'USER_AGENT': 'Mozilla/5.0 (compatible; Googlebot/2.1; ' '+http://www.google.com/bot.html)'} 2026-08-25 08:01:19 [py.warnings] WARNING: /code/lib/python3.10/site-packages/scrapy/utils/request.py:232: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2026-08-25 08:01:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2026-08-25 08:01:19 [scrapy.extensions.telnet] INFO: Telnet Password: 10925d9ee680524f 2026-08-25 08:01:19 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapy.extensions.closespider.CloseSpider'] 2026-08-25 08:01:19 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-08-25 08:01:19 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-08-25 08:01:19 [scrapy.middleware] INFO: Enabled item pipelines: ['modularspiders.pipelines.MinimumViableItemPipeline', 'modularspiders.pipelines.RedisExporter', 'modularspiders.pipelines.BulkStoreUpdate'] 2026-08-25 08:01:19 [scrapy.core.engine] INFO: Spider opened 2026-08-25 08:01:19 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-08-25 08:01:19 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027 2026-08-25 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-08-25 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-08-25 08:01:20 [cymru-beats] INFO: Found next: https://cymrubeats.com/shop/page/2/ 2026-08-25 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/doepfer-a-111-5-mini-synthesizer-voice/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Doepfer', 'name': 'Doepfer A-111-5 Mini Synthesizer voice', 'page_metadata': None, 'price': '295.00', 'product_code': 'DOE1115', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/doepfer-a-111-5-mini-synthesizer-voice/', 'vat_included': True} 2026-08-25 08:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/doepfer-a-174-4-3d-joystick/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': 'h', 'is_used': False, 'manufacturer': 'Doepfer', 'name': 'Doepfer A-174-4 3D Joystick', 'page_metadata': None, 'price': '165.00', 'product_code': 'DOEP3DJS', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/doepfer-a-174-4-3d-joystick/', 'vat_included': True} 2026-08-25 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:02:36 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 8 pages/min), scraped 2 items (at 2 items/min) 2026-08-25 08:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/befaco-knurlies-eurorack-screw-50-pack/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Befaco', 'name': 'Befaco Knurlies Eurorack Screw 50 Pack', 'page_metadata': None, 'price': '17.50', 'product_code': 'KNURL50', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/befaco-knurlies-eurorack-screw-50-pack/', 'vat_included': True} 2026-08-25 08:02:36 [cymru-beats] INFO: Found next: https://cymrubeats.com/shop/page/3/ 2026-08-25 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/joranalogue-filter-8/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Joranalogue', 'name': 'Joranalogue Filter 8', 'page_metadata': None, 'price': '250.00', 'product_code': 'JRNLGFLTR8', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/joranalogue-filter-8/', 'vat_included': True} 2026-08-25 08:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/joranalogue-receive-2/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Joranalogue', 'name': 'Joranalogue Receive 2', 'page_metadata': None, 'price': '159.00', 'product_code': 'JORR2', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/joranalogue-receive-2/', 'vat_included': True} 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:03:44 [scrapy.extensions.logstats] INFO: Crawled 12 pages (at 4 pages/min), scraped 5 items (at 3 items/min) 2026-08-25 08:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/doepfer-pb-base-case-psu3/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': 'h', 'is_used': False, 'manufacturer': 'Doepfer', 'name': 'Doepfer PB Base Case PSU3', 'page_metadata': None, 'price': '495.00', 'product_code': 'DOEPA100PB', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/doepfer-pb-base-case-psu3/', 'vat_included': True} 2026-08-25 08:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/befaco-knurlies-eurorack-screw-100-pack/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Befaco', 'name': 'Befaco Knurlies Eurorack Screw 100 Pack', 'page_metadata': None, 'price': '30.00', 'product_code': 'KNURL100', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/befaco-knurlies-eurorack-screw-100-pack/', 'vat_included': True} 2026-08-25 08:03:44 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/future-sound-systems-mute-stumm/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:44 [cymru-beats] INFO: Found next: https://cymrubeats.com/shop/page/4/ 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:03:44 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/endorphin-es-squawk-dirty-to-me/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:44 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/paratek-%d0%bb%d0%b8%d1%83-1%d1%81-no-006/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:03:44 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/addac-206-switching-sequencer/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:44 [cymru-beats] INFO: Found next: https://cymrubeats.com/shop/page/5/ 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:03:44 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:44 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/nano-mar/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/addac214-vc-rotator/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/shop/page/5/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/qu-bit-scanned/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/qu-bit-pulsar/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/2hp-kick/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/2hp-snare/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/2hp-hat/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/2hp-freez/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/noise-engineering-loquelic-iteritas-rev-2/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/2hp-vco/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/alm-quaid-megaslope/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/wmd-volt/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/4/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/tone-science-module-no%e2%80%8b-%e2%80%8b2-elements-and-particles-cd/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/joranalogue-add-2/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:03:45 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/addac503-marble-physics/>: HTTP status code is not handled or not allowed 2026-08-25 08:03:46 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:00 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:00 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/addac307-heart-sensing-%e2%9d%a4%ef%b8%8f/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/addac-501-complex-random-v2/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Addac System', 'name': 'Addac501 Complex Random V2', 'page_metadata': None, 'price': '299.00', 'product_code': 'ADAC0014', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/addac-501-complex-random-v2/', 'vat_included': True} 2026-08-25 08:04:00 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/joranalogue-transmit-2/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:00 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:00 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:00 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/expert-sleepers-fhx-8gt/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/3/) 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/doepfer-a-100b4v-blank-blind-panel-black/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/addac611-gotharmans-vc-tube-filter/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Addac System', 'name': 'Addac611 Gotharman’s VC tube filter', 'page_metadata': None, 'price': '320.00', 'product_code': 'ADDAC611', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/addac611-gotharmans-vc-tube-filter/', 'vat_included': True} 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/doepfer-mbp25-midi-bass-pedal-electronic/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/future-sound-systems-osc1-cyclical-engine/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/endorphin-es-power/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/endorphin-es-godspeed/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/endorphin-es-airstreamer/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/patch-tweak/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/vermona-modular-twincussion/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/vermona-tvcf/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://cymrubeats.com/product/vermona-modular-tvcf-extension/>: HTTP status code is not handled or not allowed 2026-08-25 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/page/2/) 2026-08-25 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:04:47 [scrapy.extensions.logstats] INFO: Crawled 51 pages (at 39 pages/min), scraped 9 items (at 4 items/min) 2026-08-25 08:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/io-instruments-euporie/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'IO Instruments', 'name': 'IO instruments Euporie', 'page_metadata': None, 'price': '130.00', 'product_code': 'IOINSEUP', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/io-instruments-euporie/', 'vat_included': True} 2026-08-25 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/endorphin-es-queen-of-pentacles/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Endorphin.es', 'name': 'Endorphin.es Queen of Pentacles', 'page_metadata': None, 'price': '475.00', 'product_code': 'ENDOQUEEN', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/endorphin-es-queen-of-pentacles/', 'vat_included': True} 2026-08-25 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/doepfer-a-111-6-mini-synthesizer/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Doepfer', 'name': 'Doepfer A-111-6 Mini Synthesizer slim', 'page_metadata': None, 'price': '180.00', 'product_code': 'DOE1116', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/doepfer-a-111-6-mini-synthesizer/', 'vat_included': True} 2026-08-25 08:05:57 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 2 pages/min), scraped 12 items (at 3 items/min) 2026-08-25 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/animal-factory-orobas/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Animal Factory', 'name': 'Animal Factory Orobas', 'page_metadata': None, 'price': '459.00', 'product_code': 'ANIMOROB', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/animal-factory-orobas/', 'vat_included': True} 2026-08-25 08:06:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cymrubeats.com/shop/) 2026-08-25 08:07:06 [scrapy.extensions.logstats] INFO: Crawled 54 pages (at 1 pages/min), scraped 13 items (at 1 items/min) 2026-08-25 08:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/doepfer-a-174-4v-3d-joystick-black/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Doepfer', 'name': 'Doepfer A-174-4v 3D Joystick black', 'page_metadata': None, 'price': '175.00', 'product_code': 'DOEP3DJB', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/doepfer-a-174-4v-3d-joystick-black/', 'vat_included': True} 2026-08-25 08:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/black-corporation-deckards-voice/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Black Corporation', 'name': "Black Corporation Deckard's Voice", 'page_metadata': None, 'price': '750.00', 'product_code': 'BLCKDECK', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/black-corporation-deckards-voice/', 'vat_included': True} 2026-08-25 08:07:36 [scrapy.extensions.logstats] INFO: Crawled 54 pages (at 0 pages/min), scraped 15 items (at 2 items/min) 2026-08-25 08:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://cymrubeats.com/product/strymon-starlab/> {'batch_id': '2604', 'currency_code': 'GBP', 'html': None, 'image_url': '/', 'is_used': False, 'manufacturer': 'Strymon', 'name': 'Strymon Starlab', 'page_metadata': None, 'price': '519.00', 'product_code': 'STRYSTAR', 'ships_from_region': 'GB', 'stock_status': 1, 'store_code': 'cymru-beats', 'url': 'https://cymrubeats.com/product/strymon-starlab/', 'vat_included': True} 2026-08-25 08:07:36 [scrapy.core.engine] INFO: Closing spider (finished) 2026-08-25 08:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): wigglehunt.com:443 2026-08-25 08:07:36 [py.warnings] WARNING: /code/lib/python3.10/site-packages/urllib3/connectionpool.py:1045: InsecureRequestWarning: Unverified HTTPS request is being made to host 'wigglehunt.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings warnings.warn( 2026-08-25 08:07:36 [urllib3.connectionpool] DEBUG: https://wigglehunt.com:443 "GET /api/v1/_ingest-complete?store_code=cymru-beats&batch_id=2604 HTTP/1.1" 400 None 2026-08-25 08:07:36 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 20898, 'downloader/request_count': 54, 'downloader/request_method_count/GET': 54, 'downloader/response_bytes': 663767, 'downloader/response_count': 54, 'downloader/response_status_count/200': 21, 'downloader/response_status_count/404': 33, 'elapsed_time_seconds': 376.659039, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2026, 8, 25, 8, 7, 36, 609174), 'httpcompression/response_bytes': 2894427, 'httpcompression/response_count': 54, 'httperror/response_ignored_count': 33, 'httperror/response_ignored_status_count/404': 33, 'item_scraped_count': 16, 'log_count/DEBUG': 73, 'log_count/INFO': 53, 'log_count/WARNING': 2, 'memusage/max': 100114432, 'memusage/startup': 77160448, 'request_depth_max': 4, 'response_received_count': 54, 'robotstxt/request_count': 1, 'robotstxt/response_count': 1, 'robotstxt/response_status_count/200': 1, 'scheduler/dequeued': 53, 'scheduler/dequeued/memory': 53, 'scheduler/enqueued': 53, 'scheduler/enqueued/memory': 53, 'start_time': datetime.datetime(2026, 8, 25, 8, 1, 19, 950135)} 2026-08-25 08:07:36 [scrapy.core.engine] INFO: Spider closed (finished)