2026-07-29 17:03:34 [scrapy.utils.log] INFO: Scrapy 2.8.0 started (bot: modularspiders)
2026-07-29 17:03:34 [scrapy.utils.log] INFO: Versions: lxml 4.9.2.0, libxml2 2.9.14, cssselect 1.2.0, parsel 1.7.0, w3lib 2.1.1, Twisted 22.10.0, Python 3.10.15 (main, Oct 19 2024, 04:00:28) [GCC 12.2.0], pyOpenSSL 23.1.1 (OpenSSL 3.1.0 14 Mar 2023), cryptography 40.0.1, Platform Linux-5.10.0-21-amd64-x86_64-with-glibc2.36
2026-07-29 17:03:34 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'modularspiders',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 4,
 'LOG_FILE': 'logs/default/post/f830600c8b6e11f197600242ac11000b.log',
 'NEWSPIDER_MODULE': 'modularspiders.spiders',
 'ROBOTSTXT_OBEY': True,
 'SPIDER_MODULES': ['modularspiders.spiders'],
 'USER_AGENT': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) '
               'AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.135 '
               'Safari/537.36'}
2026-07-29 17:03:34 [py.warnings] WARNING: /code/lib/python3.10/site-packages/scrapy/utils/request.py:232: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting.

It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy.

See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation.
  return cls(crawler)

2026-07-29 17:03:34 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor
2026-07-29 17:03:34 [scrapy.extensions.telnet] INFO: Telnet Password: 2232641383607e47
2026-07-29 17:03:34 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-07-29 17:03:34 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-07-29 17:03:34 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-07-29 17:03:34 [scrapy.middleware] INFO: Enabled item pipelines:
['modularspiders.pipelines.MinimumViableItemPipeline',
 'modularspiders.pipelines.RedisExporter',
 'modularspiders.pipelines.BulkStoreUpdate']
2026-07-29 17:03:34 [scrapy.core.engine] INFO: Spider opened
2026-07-29 17:03:34 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-07-29 17:03:34 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-07-29 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/robots.txt> (referer: None)
2026-07-29 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/sitemap_index.xml> (referer: None)
2026-07-29 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/product-sitemap.xml> (referer: https://postmodular.co.uk/sitemap_index.xml)
2026-07-29 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/wav-player/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/addac111-ultra-wav-player/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/tyso-daiko-alm031/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/904a-low-pass-filter/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/7u-case-joiners-pair/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/gaeto/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/wav-player/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/ADDAC101_VS2.jpg',
 'is_used': False,
 'name': 'ADDAC101 – .WAV Player',
 'page_metadata': None,
 'price': '335',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/wav-player/',
 'vat_included': False}
2026-07-29 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/addac111-ultra-wav-player/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/ADDAC111_F.jpg',
 'is_used': False,
 'name': 'ADDAC111 – Ultra .WAV Player',
 'page_metadata': None,
 'price': '475',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/addac111-ultra-wav-player/',
 'vat_included': False}
2026-07-29 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/serge-vc-resonant-equalizer-vcreseq/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/akemies-taiko/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/serge-resonant-equalizer-eq/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/rt-1701-multi-fx-module-effexx/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/tyso-daiko-alm031/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Tyso-Daiko.jpg',
 'is_used': False,
 'name': 'Tyso Daiko (ALM031)',
 'page_metadata': None,
 'price': '294',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/tyso-daiko-alm031/',
 'vat_included': False}
2026-07-29 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/904a-low-pass-filter/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/904A.jpg',
 'is_used': False,
 'name': '904A Low Pass Filter',
 'page_metadata': None,
 'price': '190',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/904a-low-pass-filter/',
 'vat_included': False}
2026-07-29 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/7u-case-joiners-pair/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/joinersoncase.jpg',
 'is_used': False,
 'name': '7U case Joiners (pair)',
 'page_metadata': None,
 'price': '38',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/7u-case-joiners-pair/',
 'vat_included': False}
2026-07-29 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/gaeto/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Gaeto-black-front.png',
 'is_used': False,
 'name': 'GAETO',
 'page_metadata': None,
 'price': '95',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/gaeto/',
 'vat_included': False}
2026-07-29 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/timiszoara/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/morgasmatron/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/four-seas/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/ochd/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/serge-vc-resonant-equalizer-vcreseq/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/VCResEQ_Serge.jpeg',
 'is_used': False,
 'name': 'Serge VC Resonant Equalizer (VCResEQ)',
 'page_metadata': None,
 'price': '770',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/serge-vc-resonant-equalizer-vcreseq/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/akemies-taiko/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Akemies-Taiko.jpg',
 'is_used': False,
 'name': 'Akemie’s Taiko (ALM015)',
 'page_metadata': None,
 'price': '255',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/akemies-taiko/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/serge-resonant-equalizer-eq/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Serge_ResEQ_module-1.jpg',
 'is_used': False,
 'name': 'SERGE RESONANT EQUALIZER (EQ)',
 'page_metadata': None,
 'price': '374',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/serge-resonant-equalizer-eq/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/rt-1701-multi-fx-module-effexx/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/RT-1701_EFFEXX.jpg',
 'is_used': False,
 'name': 'RT-1701 MULTI-FX-MODULE  EFFEXX',
 'page_metadata': None,
 'price': '465',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/rt-1701-multi-fx-module-effexx/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/vcradio/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/weaver-modular/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/buchla-258t/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/variable-bandwidth-filter-vcf2/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/timiszoara/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/timiszoara.png',
 'is_used': False,
 'name': 'TIMISZOARA',
 'page_metadata': None,
 'price': '314',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/timiszoara/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 21 pages/min), scraped 11 items (at 11 items/min)
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/morgasmatron/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Morgasmatron-e1541110540942.jpg',
 'is_used': False,
 'name': 'Morgasmatron',
 'page_metadata': None,
 'price': '355',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/morgasmatron/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/four-seas/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/4SEAS.jpg',
 'is_used': False,
 'name': 'Four Seas',
 'page_metadata': None,
 'price': '524',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/four-seas/',
 'vat_included': False}
2026-07-29 17:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/ochd/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/ochd3.png',
 'is_used': False,
 'name': 'øchd',
 'page_metadata': None,
 'price': '154',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/ochd/',
 'vat_included': False}
2026-07-29 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/serge-variable-slope-filter-vcfs/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/extended-adsr/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/serge-triple-waveshaper-tws/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/sto/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/vcradio/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/VCRadio_FRONT-scaled.jpg',
 'is_used': False,
 'name': 'VCRadio',
 'page_metadata': None,
 'price': '176',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/vcradio/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/weaver-modular/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Black_FieldTone_Weaver_Mod.jpg',
 'is_used': False,
 'name': 'Weaver Modular (all panels)',
 'page_metadata': None,
 'price': '250',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/weaver-modular/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/buchla-258t/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Dual-Oscillator-Model-258t.png',
 'is_used': False,
 'name': 'Buchla 258t',
 'page_metadata': None,
 'price': '165',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/buchla-258t/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/variable-bandwidth-filter-vcf2/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/VCF2.png',
 'is_used': False,
 'name': 'VARIABLE BANDWIDTH FILTER (VCF2)',
 'page_metadata': None,
 'price': '320',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/variable-bandwidth-filter-vcf2/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/multi-envelope/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/invert-mix/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/rings/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://postmodular.co.uk/modules/syntrx/> (referer: https://postmodular.co.uk/product-sitemap.xml)
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/serge-variable-slope-filter-vcfs/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Serge_VCFS.jpg',
 'is_used': False,
 'name': 'SERGE VARIABLE SLOPE FILTER (VCFS)',
 'page_metadata': None,
 'price': '282',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/serge-variable-slope-filter-vcfs/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 8 pages/min), scraped 19 items (at 8 items/min)
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/extended-adsr/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/ExtADSR.png',
 'is_used': False,
 'name': 'EXTENDED ADSR',
 'page_metadata': None,
 'price': '254',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/extended-adsr/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/serge-triple-waveshaper-tws/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Serge-triple-waveshaper.jpg',
 'is_used': False,
 'name': 'SERGE TRIPLE+ WAVESHAPER (TWS+)',
 'page_metadata': None,
 'price': '260',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/serge-triple-waveshaper-tws/',
 'vat_included': False}
2026-07-29 17:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/sto/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/sto_900.jpg',
 'is_used': False,
 'name': 'STO',
 'page_metadata': None,
 'price': '190',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/sto/',
 'vat_included': False}
2026-07-29 18:37:43 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 0 pages/min), scraped 22 items (at 3 items/min)
2026-07-29 18:37:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/rene-mk2/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/rene-mk2/ took longer than 180.0 seconds..
2026-07-29 18:37:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/trouser-press/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/trouser-press/ took longer than 180.0 seconds..
2026-07-29 18:37:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/gods-box-humpback/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/gods-box-humpback/ took longer than 180.0 seconds..
2026-07-29 18:37:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/gem-lp-filter/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/gem-lp-filter/ took longer than 180.0 seconds..
2026-07-29 18:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/multi-envelope/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/multi-envelope.jpg',
 'is_used': False,
 'name': 'Multi-Envelope',
 'page_metadata': None,
 'price': '421',
 'ships_from_region': 'GB',
 'stock_status': 1,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/multi-envelope/',
 'vat_included': False}
2026-07-29 18:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/invert-mix/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/invert-mix.png',
 'is_used': False,
 'name': 'INVERT MIX',
 'page_metadata': None,
 'price': '64',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/invert-mix/',
 'vat_included': False}
2026-07-29 18:37:45 [scrapy.core.engine] INFO: Closing spider (closespider_timeout)
2026-07-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/rings/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/Rings.jpg',
 'is_used': False,
 'name': 'Rings',
 'page_metadata': None,
 'price': '244',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/rings/',
 'vat_included': False}
2026-07-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://postmodular.co.uk/modules/syntrx/>
{'batch_id': '2530',
 'currency_code': 'GBP',
 'html': None,
 'image_url': 'https://postmodular.co.uk/wp-content/uploads/SYNTRX-web-3.jpg',
 'is_used': False,
 'name': 'SYNTRX',
 'page_metadata': None,
 'price': '2045',
 'ships_from_region': 'GB',
 'stock_status': 0,
 'store_code': 'post',
 'url': 'https://postmodular.co.uk/modules/syntrx/',
 'vat_included': False}
2026-07-29 18:38:43 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 0 pages/min), scraped 26 items (at 4 items/min)
2026-07-29 18:43:35 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 0 pages/min), scraped 26 items (at 0 items/min)
2026-07-29 18:43:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/gem-hp/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/gem-hp/ took longer than 180.0 seconds..
2026-07-29 18:43:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/cvgt1/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/cvgt1/ took longer than 180.0 seconds..
2026-07-29 18:43:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/16-voice-demon-core-oscillator/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/16-voice-demon-core-oscillator/ took longer than 180.0 seconds..
2026-07-29 18:43:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://postmodular.co.uk/modules/demon-core-expander/> (failed 1 times): User timeout caused connection failure: Getting https://postmodular.co.uk/modules/demon-core-expander/ took longer than 180.0 seconds..
2026-07-29 18:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): wigglehunt.com:443
2026-07-29 18:44:08 [py.warnings] WARNING: /code/lib/python3.10/site-packages/urllib3/connectionpool.py:1045: InsecureRequestWarning: Unverified HTTPS request is being made to host 'wigglehunt.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
  warnings.warn(

2026-07-29 18:45:27 [urllib3.connectionpool] DEBUG: https://wigglehunt.com:443 "GET /api/v1/_ingest-complete?store_code=post&batch_id=2530 HTTP/1.1" 504 641
2026-07-29 18:45:27 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 8,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 8,
 'downloader/request_bytes': 14078,
 'downloader/request_count': 37,
 'downloader/request_method_count/GET': 37,
 'downloader/response_bytes': 1328767,
 'downloader/response_count': 29,
 'downloader/response_status_count/200': 29,
 'elapsed_time_seconds': 6113.212977,
 'finish_reason': 'closespider_timeout',
 'finish_time': datetime.datetime(2026, 7, 29, 18, 45, 27, 766426),
 'httpcompression/response_bytes': 5770814,
 'httpcompression/response_count': 29,
 'item_scraped_count': 26,
 'log_count/DEBUG': 66,
 'log_count/INFO': 15,
 'log_count/WARNING': 2,
 'memusage/max': 113909760,
 'memusage/startup': 76836864,
 'request_depth_max': 2,
 'response_received_count': 29,
 'retry/count': 8,
 'retry/reason_count/twisted.internet.error.TimeoutError': 8,
 'robotstxt/request_count': 1,
 'robotstxt/response_count': 1,
 'robotstxt/response_status_count/200': 1,
 'scheduler/dequeued': 36,
 'scheduler/dequeued/memory': 36,
 'scheduler/enqueued': 1011,
 'scheduler/enqueued/memory': 1011,
 'start_time': datetime.datetime(2026, 7, 29, 17, 3, 34, 553449)}
2026-07-29 18:45:27 [scrapy.core.engine] INFO: Spider closed (closespider_timeout)