Releases: tomasnorre/crawler
Releases · tomasnorre/crawler
[RELEASE] Crawler version 12.0.10
What's Changed
- [BUGFIX] Set guzzle connect timeout to 5 seconds by @cweiske in #1159
- [FEATURE] Extract error information in SubProcess crawl strategy by @cweiske in #1161
- [TASK] Fix ddev typo3 upgrade wizard call by @cweiske in #1163
- [CI] Update Acceptance Tests for PR branches by @tomasnorre in #1168
- [BUGFIX] Prevent warning when guzzle crawl requests return errors by @cweiske in #1167
- Guzzle error warning2 by @cweiske in #1169
- chore(deps): bump actions/setup-node from 4 to 5 by @dependabot[bot] in #1170
- [FEATURE] Expose error when crawl response has no X-T3Crawler-Meta header by @cweiske in #1171
- [TASK] Remove redundant checks by @tomasnorre in #1176
- [TASK] Cleanup CrawlerController by @tomasnorre in #1178
- [TASK] Cleanup ResultHandler by @tomasnorre in #1179
- [TASK] Cleanup UrlBuilder by @tomasnorre in #1180
- [TASK] Cleanup CSVWriter by @tomasnorre in #1181
- [TASK] Remove obsolete check in CrawlerController by @tomasnorre in #1182
- [TASK] Refactor ProcessCleanupHook, extract logic to ProcessManager and ProcessCleaner classes by @tomasnorre in #1183
- [TASK] Refactor BackendModuleLogService by @tomasnorre in #1184
- [CI] Switch to GitHub composer actions by @tomasnorre in #1187
- Declare parameter explicitly nullable by @julianhofmann in #1188
- [TASK] Update PHPStan Baseline rewording of error by @tomasnorre in #1189
- [TASK] Use fixed Greetings action to avoid breaking changes by @tomasnorre in #1190
- [TASK] Improve types in ModifySkipEvent by @tomasnorre in #1191
- [TASK] Rename internal variable to match PHP functions by @tomasnorre in #1192
- [TASK] Remove redundant check by @tomasnorre in #1193
- [TASK] Remove unused private constant by @tomasnorre in #1194
- [TASK] Cleanup ConfigurationService by @tomasnorre in #1196
- [TASK] Cleanup CallbackExecutionStrategy by @tomasnorre in #1197
- [TASK] Cleanup SubProcessExecutionStrategy by @tomasnorre in #1195
- [TASK] Add RequestHelper to cleanup the BackendControllers by @tomasnorre in #1198
- [CI] set-output in workflows is deprecated by @tomasnorre in #1199
- [TASK] Improve tests by @tomasnorre in #1200
- [TASK] Improve tests by @tomasnorre in #1201
- fix: update composer dependencies by @tomasnorre in #1203
- chore(deps): bump actions/setup-node from 5 to 6 by @dependabot[bot] in #1204
- [FEATURE] Automatic reload process status without page reload by @tomasnorre in #1205
- chore(deps): bump playwright and @playwright/test in /Tests/Acceptance-Playwright by @dependabot[bot] in #1207
- [CI] Improve Playwright ci by @tomasnorre in #1208
- [DEVBOX] Update Devbox files by @tomasnorre in #1210
- [CI] Improve CodeCeption ci by @tomasnorre in #1209
- [BUGFIX] Ensure Logdepth is kept on manual crawl in log module by @tomasnorre in #1185
- chore(deps): bump actions/upload-artifact from 4 to 5 by @dependabot[bot] in #1212
New Contributors
- @julianhofmann made their first contribution in #1188
Full Changelog: 12.0.9...12.0.10
[RELEASE] Crawler version 12.0.9
What's Changed
- Bump tomasnorre/typo3-upload-ter from 2.2.3 to 2.2.4 by @dependabot[bot] in #1144
- [BUGFIX] use frontend.cache.instruction attribute instead of TSFE no_cache for TYPO3 13 (#1140) by @luisbecker-gh in #1145
- Bump actions/first-interaction from 1 to 2 by @dependabot[bot] in #1147
- fix: Ensure that pages are added to queue when page cache is cleared by @tomasnorre in #1150
- fix: Ensure that selection are kept on Update URLs in Crawler Start Module by @tomasnorre in #1152
- Bump actions/checkout from 4 to 5 by @dependabot[bot] in #1154
- Bump actions/first-interaction from 2 to 3 by @dependabot[bot] in #1153
- fix: Ensure pageRow uid is set before trying to add to queue by @tomasnorre in #1149
- [DOCS] Setup How-To for indexed_search + crawler by @cweiske in #1156
- [TASK] Update CI Workflows by @tomasnorre in #1157
New Contributors
- @luisbecker-gh made their first contribution in #1145
Full Changelog: 12.0.8...12.0.9
[RELEASE] Crawler version 12.0.8
What's Changed
- ci: remove coverage on tests where not needed, to speed up tests by @tomasnorre in #1122
- [BUGFIX] Ensure that correct typo3 binary is returned in non-composer installations by @tomasnorre in #1126
- [TASK] Refactor commands by @tomasnorre in #1127
- [TASK] Remove internal ref for CrawlerController by @tomasnorre in #1128
- [TASK] Remove cli/conf.php as it is not used since a long time by @tomasnorre in #1129
- [BUGFIX] Adjust path in cli/bootstrap.php to match new folder structure of where extensions are installed by @tomasnorre in #1131
- [BUGFIX] fix crawling of mount pages by @hannesbochmann in #1134
- [BUGFIX] Do not wrap empty HTML in table-tag to ensure valid HTML by @tomasnorre in #1133
- [TASK] Switch to the new rendering by @linawolf in #1136
- Bump tomasnorre/typo3-upload-ter from 2.1.0 to 2.2.0 by @dependabot in #1138
- Bump getong/mariadb-action from 1.1 to 1.11 by @dependabot in #1139
- Bump tomasnorre/typo3-upload-ter from 2.2.0 to 2.2.1 by @dependabot in #1141
- [BUGFIX] Fix indexing of cached pages when "disableFrontendIndexing" … by @cweiske in #1142
- Bump tomasnorre/typo3-upload-ter from 2.2.1 to 2.2.3 by @dependabot in #1143
New Contributors
- @hannesbochmann made their first contribution in #1134
- @linawolf made their first contribution in #1136
- @dependabot made their first contribution in #1138
Full Changelog: 12.0.7...12.0.8
[RELEASE] Crawler version 11.0.11
What's Changed
- Backport of #1009 by @Hawkeye1909 in #1089
- [CI] Update PHPStan baseline by @tomasnorre in #1092
- BUGFIX: Typecast PageTS Crawler Configuration force_ssl to int by @tomasnorre in #1112
- [BUGFIX] Catch E_WARNING when unserialize() fails by @cweiske in #1117
Full Changelog: 11.0.10...11.0.11
[RELEASE] Crawler version 11.0.10
Fixes:
- Check queueRec before usages to avoid php-errors
[RELEASE] Crawler version 12.0.3
Regression, enables installed on non-composer projects again
[RELEASE] Crawler version 11.0.9
Regression, enables installed on non-composer projects again
[RELEASE] Crawler version 12.0.1
Fixed
- Prevent undefined array key uid and username in FrontendUserAuthentication
[RELEASE] Crawler version 11.0.8
Fixed
- Fix loading middleware order to make forced indexing work again @cweiske
- Avoid deprecations in PHP 8.2
- Ensure that directory for lock file for enabling/disabling crawler exits
[RELEASE] Crawler version 12.0.0
Added
- AbstractBackendModuleController
- BackendModuleController
- BackendModuleCrawlerLogController
- BackendModuleCrawlerProcessController
- BackendModuleStartCrawlingController
- Support for PHP 8.2
- Support for PHP 8.3
Changed
- !!! Switch constants in ProcessQueueCommand from public to private
- !!! Add interface to CrawlStrategy filename
- !!! Switch getExtensionIcon() in TcaUtility from protected to private
- !!! Add Type Hints for id parameters on RequestForm Render method
- !!! Switch runPollSuccessHooks() in CrawlerInitialization from protected to private
- !!! Switch isRequestHashMatchingQueueRecord() in FrontendUserAuthenticator from protected to private
- !!! CrawlerHookInterface doesn't take a CrawlerController as input anymore
- !!! ResultHandler moved to Controller/Backend/Helper
- !!! UrlBuilder moved to Controller/Backend/Helper
- !!! Mark all classes @internal that are not already marked as internal
Fixed
- If indexed_search is installed activate procInstructions for indexed_search
- Avoid deprecations in PHP 8.2
- Prevent undefined array key uid and username in FrontendUserAuthentication
- Fix loading middleware order to make forced indexing work again @cweiske
- Change tense in flush command message @cweiske
- Ensure that directory for lock file for enabling/disabling crawler exits
Deprecated
Functions & Properties
- CrawlerController->drawURLs_PIfilter()
Removed
- Obsolete columns (first and last time) from Process Overview
- !!! Remove constructor form RequestFormInterface
- !!! Support for TYPO3 10
- !!! Support for TYPO3 11 (Only in main branch, v12.0.0)
- !!! PHP support for
<8.0 - !!! PHP support for
<8.1(Only in main branch, v12.0.0) - Remove CLI_hooks from ProcessQueueCommand
- !!! ClassAliasMap & LegacyClassesForIde Migrations
- !!! Remove Symfony Components
<6.4from composer.json
Classes
- !!! AbstractCommandTests
- !!! IndexedSearchCrawlerHook
- !!! CrawlerApi
- !!! IndexedSearchCrawlerFilesHook
- !!! BackendModule
- !!! AbstractRequestForm
- !!! LogRequestForm
- !!! RequestFormFactory
- !!! RequestFormInterface
- !!! StartRequestForm
- !!! MultiProcessRequestForm
- !!! BackendUtility
Functions & Properties
- !!! CrawlerController->modMenu()
- !!! ConfigurationRepository->getCrawlerConfigurationRecords()
- !!! ConfigurationService->getUrlService()
- !!! FrontendUserAuthenticator->queueRepository
- !!! ProcessRepository->countActive()
- !!! ProcessRepository->findByProcessId()
- !!! ProcessRepository->getLimitFromItemCountAndOffset()
- !!! ProcessQueueCommandTest->queueRepository
- !!! QueueRepository->isPageInQueueTimed()
- !!! QueueRepository->getAvailableSets()
- !!! QueueRepository->countAllUnassignedPendingItems()
- !!! QueueRepository->countPendingItemsGroupedByConfigurationKey()
- !!! QueueRepository->getSetIdWithUnprocessedEntries()
- !!! QueueRepository->getTotalQueueEntriesByConfiguration()
- !!! QueueRepository->getLastProcessedEntriesTimestamps()
- !!! QueueRepository->getLastProcessedEntries()
- !!! QueueRepository->getPerformanceData()
- !!! QueueRepository->findByQueueId()