Skip to content

Releases: zouzias/spark-lucenerdd

v0.2.5

09 Jan 07:20
Compare
Choose a tag to compare

Changelog:

*Update to Spark 2.1.0
*Update to Scalatest 3.x
*Add toString method in SparkScoreDoc
*Update minor versions on dependencies joda-time and algebird
*Fix return type on scripts

v0.2.4

10 Dec 10:32
Compare
Choose a tag to compare

Changelog:

  • Update Spark version to 2.0.2
  • Add moreLikeThis functionality in LuceneRDD

v0.2.3

10 Dec 10:31
Compare
Choose a tag to compare

Changelog:

General

  • Introduce Versionable trait

Linkage:

  • Multithreaded search on each partition (LuceneRDD, ShapeLuceneRDD)
  • Remove unnecessary topK monoid reduce
  • Response is Array[List[SparkScoreDoc] not List[SparkScoreDoc]

LuceneRDD:

  • Add deduplication method dedup

ShapeLuceneRDD

  • Add implicitis for DataFrames

v0.2.2

20 Oct 19:40
Compare
Choose a tag to compare

Changelog:

  • Unpersist broadcast variables on all link methods
  • Add .version method on all main RDDs
  • Rename GridLoader to PrefixTreeLoader
  • Remove multivalued fields in SparkDoc
  • Configurable prefix tree in ShapeLuceneRDD (via spatial.prefixtree.name={geohash|quad}

Add Kryo serialization on all classes

09 Oct 14:00
Compare
Choose a tag to compare

Changelog:

  • All used classes are registered under LuceneRDDKryoRegistrator.
  • Bump Spark version to 2.0.1

v0.0.24

06 Sep 17:28
Compare
Choose a tag to compare
  • Fix critical bug on TopKMonoids for LuceneRDD and FacetedLuceneRDD
  • Trait SparkScoreDocAggregatable is removed.
  • Set TopKMonoid size to topK input parameter (instead of MaxDefaultTopK) in LuceneRDD.link

v0.0.22

02 Sep 17:31
Compare
Choose a tag to compare