Skip to content
Paul Rogers edited this page Dec 2, 2019 · 30 revisions

Vector Checks

Branches:

  • DRILL-7324: new PR
  • CountFix*: - prior versions

Tasks:

  • Run full tests (Done)
  • Fix issues (Done)
  • PR for turning on all vector checks (Done)
  • Respond to comments (Done, statistics batch fixed)

JSON Reader

Branches:

  • DRILL-6953-rev - Newest version
  • DRILL-6953 - Original version with a bunch of batch count fixes

Tasks:

  • Copy files into new branch (Done)
  • Test (Done)
  • PR (Done)

Follow-on work:

  • Refactor to allow use of JSON reader outside of JSON file scan
  • Provided-schema support
  • Review past two years of JSON changes
  • Switch JSON function to use this reader
  • Switch Kafka to use this reader

Base/Dummy scan

  • Sumo distribution works
  • Update docs with that info
  • Merge latest change from Sumo branch
  • PR for base/dummy scan.

Revised Copier

On branch svr-exp3

  • Get copier to work with bulk copy. (Done)
  • Split copier tests into multiple files. (Done)
  • Bulk copy tests for structured data types. (Done)
  • PR for move of allocator into RSL options.
  • PR for restructure of reader creator and indexes.
  • PR for bulk copy feature in RSL
  • PR for copier

Current problem: TestCsvWithSchema.testBlankCols() fails with SV4 from sort. Likely problem is batch ownership. Maybe first move merging into sort?

Remove Old Sort

  • PR to remove code, shift "managed" sort

Revised Mock

  • Revise, PR ColumnMetadata
  • Revise mock to keep its structure externally, use CMD internally
  • Revise to use Base structure

PR for general clean-up.

  • Copy from copier branch
  • Copy from Sumo branch
  • Copy from mock branch
  • Copy from CountFix branch

Other

  • Remove OUT_OF_MEMORY result status
Clone this wiki locally