Skip to content

Release 11.1.0 (major)
Compare
Choose a tag to compare
@dkd-kaehm dkd-kaehm released this 20 Aug 12:34
11.1.0
d3f9a91

Apache Solr for TYPO3 11.1.0 (#3002)

We are happy to release EXT:solr 11.1.0.
The focus of this release has been on URL and SEO optimizations.

Important: This version is installable with TYPO3 10 LTS only and contains some breaking changes, see details below.

New in this release:

Route enhancers (#2755)

Introduce the TYPO3s route enhancer functionality for facets.
This feature allows to mask facets inside the query string or as part of the path segment.

See:

Associative keys for tx_solr[filter] facet URL parameters (#2705)

Introduce a new style how the facet array represented inside of the url with a combination of key and value in order to be able to keep a specific order.

This feature allows to change the url parameters from index based to associative keys for facets.
Using associative keys, the value of a facet will be replaced with 1. A value of 1 means, that the facet is active. A value of 0 means, the value is inactive.

Additionaly a new sort option for url parameters is available. The sort of parameters is mandatory for associative keys.

By default Solr behaves as before and will be changed in future releases.

ASCII and Scandinavian Folding Filter (#2963)

To improve the search behaviour we introduce folding filters, e.g. allowing to skip accents in search terms. The following languages are
now using the ASCII folding filter:

  • dutch
  • english
  • finish
  • french
  • german
  • hungarian
  • irish
  • italian
  • polish
  • portuguese
  • serbian (for fields that don't include the Serbian Normalization Filter)
  • spanish
  • turkish

For the Scandinavian languages, Norwegian, Swedish and Danish, a similiar approach is used, but we're using the more specialized Scandinavian Normalization
and Scandinavian Folding Filters.

Folding process usally takes place at a late stage, so your configurations shouldn't be affected. But for the Scandinavian languages the Scandinavian Normalization
Filter processes the terms earlier, so your protected words for the Snowball Porter Filter, e.g. danish/protwords.txt, might be affected, please be sure to use the
right spelling (see https://solr.apache.org/guide/8_8/language-analysis.html#scandinavian-normalization-filter).

cHash configuration 7b0e77c (#2972)

EXT:solrs components like range facets can not be properly handled by cHash stack, because the amount of possible range-combinations is infinite, therefore they must be excluded from cHash calculation.

This change makes it possible to exclude all EXT:solr parameters from cache hash. To prevent misconfigurations, the new extension configuration setting "pluginNamespaces" was introduced, which is used in FlexForm and in
TYPO3_CONF_VARS/FE/cacheHash/excludedParameters. This setting makes it impossible to chose invalid/unhandled EXT:solr plugin namespace on FlexForm (Plugin -> Options -> Plugin Namespace)

Please follow the following migration instructions

Plugin namespaces:
Needed only if other as default (tx_solr) plugin namespace is used in instance. Add the used namespace[s] to $GLOBALS['TYPO3_CONF_VARS']['EXTENSIONS']['solr']['pluginNamespaces'] or via backend
"Settings" -> "Extension Configuration" -> "solr" -> "A list of white listed plugin namespaces"

Global q parameter:
Needed only if global "q" parameter without plugin namespace is used and wants to be included in cache hash calculation. Set the setting $GLOBALS['TYPO3_CONF_VARS']['EXTENSIONS']['solr']['pluginNamespaces'] = '1'
or enable it via backend "Settings" -> "Extension Configuration" -> "solr" -> "Include/Exclude global q parameter in/from cacheHash"

Scheduler task to optimize solr cores (#2649) (#2666)

This task allows you to optimize the indexes of given cores for a site at a planned time.

See:

Apache Solr 8.9.0 support

With EXT:solr 11.1 we support Apache Solr 8.9.0, the latest release of Apache Solr.

To see what has changed in Apache Solr please read the release notes of Apache Solr:
https://solr.apache.org/docs/8_8_2/changes/Changes.html

Map managed resources to core-name fde8a64 (#2635) (2794)

Makes it possible to manage resources per core instead of previously used per schema approach.
Now is it possible to maintain the stopwords and synonyms for each core/site separately,
and avoid mixing the synonyms between sites using same core.

Update to Solarium 6

Solarium is upgraded from version 4 to version 6, so due to changes in Solarium various classes and data types had to be adapted.

There are two major changes you have to consider while upgrading:

  • TypoScript option plugin.tx_solr.solr.timeout is dropped, settings for HTTP client $GLOBALS['TYPO3_CONF_VARS']['HTTP'] are now taken into account
  • Solr path mustn't be prepended with "/solr/", refer to the "Getting Started > Configure Extension" section in our manual

Drop TYPO3 9 compatibility

To simplify the development we've dropped the compatibility for TYPO3 9 LTS. If you need to use TYPO3 9 please use the 11.0.x branch.

Small improvements and bugfixes:

Beside the major changes we did several small improvements and bugfixes:

  • [TASK] Update TypoScript condition to Expression Language (#2996)
  • [BUGFIX] Use correct information about results per page in pagination (#2516)
  • [BUGFIX] getRangeString(): check type before format() - call (#2942)
  • [BUGFIX] set base uri to face frontend request (#2915)
  • [TASK] Add language cache to SiteUtility (#2908)
    • [TASK] Make language cache work with multi site setups (#2986)
  • [BUGFIX] Changes on sub-tree of mounted source pages are not recognized (#2925)
  • [BUGFIX] Record indexing doesn't work anymore if page queue is disabled (#2241)
  • [FEATURE] Add and improve translations (#2874)
  • [TASK] Add Danish dictionary compound word token filter (#2975)
  • [BUGFIX] Add missing applicationType to faked request (#2933)
  • [BUGFIX] Use correct html tags in templates (#2970)
  • [BUGFIX] Fix typo in CoreOptimizationModule/Index.html eb39ca6
  • [BUGFIX] Delete synonyms with URL special chars 0a6456d
  • [BUGFIX] ENV vars not handled correctly in site management module (#2576)
  • [TASK] Use LowerCaseFilterFactory 7a6ae68
  • [TASK] Bump Chart.js to v2.9.4 (#2946)
  • [BUGFIX] Delete documents for valid connections only (#2939)
  • [BUGFIX] Make relevance sorting option markable as active (#2852)
  • [FEATURE] Exclude sub entries of page/storage recursively (#2432)
  • [BUGFIX] Pass FrontendUserAuthentication to TypoScriptFrontendController (#2761)
  • [BUGFIX] remove escaping on suggestion prefix (#2917)
  • [BUGFIX] Language aspect for indexer (#2841)
    • [BUGFIX] Content id in language aspect
    • [BUGFIX] Temporary free mode fix
  • [BUGFIX] Use Iconfactory to retrieve record icons (#2900)
  • [BUGFIX] Adapt extractByQuery for Tika 1.24 3dfe978 (#2897)
  • [FEATURE] Store number of existing variants (#2870)
    • [BUGFIX] Fix expected variant results be0913d
    • [BUGFIX] Fix missing variant field value (#2879)
    • [BUGFIX] Fix handling of case sensitive variant ids (#2865)
  • [BUGFIX] Change filter for workspace (#2847)
  • [TASK] Remove TYPO3 long time ago deprecated cache class (#2884) (#2782)
  • [BUGFIX] Check if $recordUid is non-numeric before substitution (#2836)
  • [BUGFIX] Exception on Cached state of TranslateViewHelper (#2830)
  • [BUGFIX] Function call with non existing variable (#2842)
  • [FEATURE] Allow stdWrap on sorting label (#2339)
  • [TASK] Disable cache time information for ajax request (#2833)
  • [BUGFIX] using named parameter for empty string comparison (#2703)
  • [BUGFIX] removing backticks in addSelectLiteral (#2701)
  • [BUGFIX] Enable unicode when fetching pages (#2810)
  • [BUGFIX] Sites with no Solr Configuration should not be considered (#2795)
  • [BUGFIX] Quote field within score calculation (#2824)
  • [BUGFIX] garbage collector on translations (#2797)
  • [TASK] Refactor class UrlHelper (#2758)
  • [BUGFIX] Use rawurldecode on facets to handle (#2806)
  • [TASK] Change configuration files to TYPO3 file extensions (#2814)
  • [BUGFIX] Unset extendToSubPages & hidden doesn't requeue subpages (#2433)
  • [BUGFIX] Error by textTight on some values (#2180)
  • [DOCS] Fix TypoScript path for lastSearches in the docs dddccfc
  • [TASK] Remove mentions on \Apache_Solr_Document (#2789)
  • [BUGFIX] Correct Content-Type header for suggest response (#2783)
  • [DOCS] Use *_PORT variable for setting the port 4d264f2
  • [BUGFIX] Deprecated second parameter for BackendUserAuthentication->modAccess is used (#2746)
  • [TASK] Add .editorconfig (#2768)
  • [TASK] Make sure HtmlContentExtractor::cleanContent() is UTF-8 safe (#2513)
  • [BUGFIX] Fix #2511: database exception in RecordMonitor (#2511)
  • [BUGFIX] Indexing of records fails with solr 10.x+ (#2520)
  • [DOCS] Fix path of suggest in typoscript settings (#2678)
  • [DOCS] Fix links in docs and CONTRIBUTING.md (#2697)
  • [BUGFIX] Hard codes plugin namespace (#2691)
  • [BUGFIX] Restricted pages are not being indexed in Typo3 10 (#2634)
  • [DOCS] Note that config.index_enable is still needed (#2735)
  • [BUGFIX] Prevent duplicate urls for page 0 (#2718)
  • [BUGFIX] Fix assignment for page uid variable (#2663)
  • [BUGFIX] Build core base path right, when path is slash only (#2680)
  • [BUGFIX] Record Monitoring fb50448
  • [DOCS] Improvements for contributing to the documentation (#2690)
  • [TASK] Drop TYPO3 9.5 LTS support for future release 11.1.x
  • [BUGFIX] use num_found in static db table (#2667)
  • [BUGFIX] Fix missing renderType attribute in flexform for search plugin (#2661)
  • [FEATURE] Add option to override 'port' in frontend indexing URL (#2327)
  • [BUGFIX] Set accurate center position for loading animation (#2568)
  • [BUGFIX] Reset uriBuilder before building a new uri (#2656)
  • [BUGFIX] Prevent SiteNotFoundException in reports module (#2624)
  • [FEATURE] Change FileWriter configuration to use logFileInfix (#2626)
  • [BUGFIX] Ensure to hand in PSR-7 Request to TSFE->getPageAndRootlineWithDomain (#2640)
  • ... See older commits, which are a part of prevous releases

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors to this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

  • Achim Fritz
  • Benni Mack
  • Christoph Lehmann
  • Daniel Koether
  • Daniel Siepmann
  • Dmitry Dulepov
  • @dev-rke
  • @dsone
  • @FearFreddy
  • @Figilano
  • @frommo
  • Georg Ringer
  • Jens Jacobsen
  • Lars Tode
  • @leslawp
  • Marc Bastian Heinrichs
  • Markus Friedrich
  • Markus Kobligk
  • Michiel Roos
  • Peter, CyberForum e.V
  • Philipp Kitzberger
  • Rafael Kähm
  • Ruud Silvrants
  • Sascha Egerer
  • Sebastian Hofer
  • Sebastian Michaelsen
  • Stefano Kowalke
  • Stephan Brun
  • Sybille Peters
  • Timo Hund
  • Tobias Kretschmann

Also a big thanks to our partners that have joined the EB2021 program:

  • +Pluswerk AG
  • 711media websolutions GmbH
  • Abt Sportsline GmbH
  • ACO Severin Ahlmann GmbH & Co. KG
  • AVM Computersysteme Vertriebs GmbH
  • cosmoblonde GmbH
  • creativ clicks GmbH
  • cron IT GmbH
  • CS2 AG
  • CW Media & Systems
  • Earlybird GmbH & Co KG
  • FLOWSITE GmbH
  • form4 GmbH & Co. KG
  • Getdesigned GmbH
  • Granpasso Digital Strategy GmbH
  • Ikanos GmbH
  • internezzo ag
  • Intersim AG
  • Ion2s GmbH
  • Leitgab Gernot
  • mellowmessage GmbH
  • Moselwal Digitalagentur UG (haftungsbeschränkt)
  • network.publishing Möller-Westbunk GmbH
  • OST Ostschweizer Fachhochschule
  • Plan.Net Suisse AG
  • Provitex GmbH
  • punkt.de GmbH
  • queo GmbH
  • Rechnungshof
  • Schoene neue kinder GmbH
  • SIT GmbH
  • SIZ GmbH
  • Stämpfli AG
  • Triplesense Reply Frankfurt
  • TWT reality bytes GmbH
  • visol digitale Dienstleistungen GmbH
  • Web Commerce GmbH
  • webconsulting business services gmbh
  • webschuppen GmbH
  • Webstobe GmbH
  • Webtech AG
  • wow! solution
  • XIMA MEDIA GmbH
  • Bundesanstalt Statistik Österreich
  • ECOS TECHNOLOGY GMBH
  • Fachhochschule Erfurt
  • Hochschule Furtwangen - IMZ Online-Services
  • Hochschule Niederrhein University of Applied Sciences
  • l'Autorité des marchés financiers
  • La Financière agricole du Québec
  • LfdA - Labor für digitale Angelegenheiten GmbH

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

  • Submit bug reports and feature requests on GitHub
  • Ask or help or answer questions in our Slack channel
  • Provide patches through Pull Request or review and comment on existing Pull Requests
  • Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us by becoming an EB partner:

https://shop.dkd.de/Produkte/Apache-Solr-fuer-TYPO3/

or call:

+49 (0)69 - 2475218 0

Contributors

dsone, dev-rke, and 4 other contributors
Assets 3
Loading