-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathHDP-CHANGES.txt
192 lines (186 loc) · 14.8 KB
/
HDP-CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
HDP-2.5 is based on Apache HBase 1.1.2
Following are the changes on top of Apache HBase 1.1.2
HBASE-15925 compat-module maven variable not evaluated (Sean Busbey)
HBASE-16056 Procedure v2 - fix master crash for FileNotFound (Matteo Bertozzi)
HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang)
HBASE-14598 ByteBufferOutputStream grows its HeapByteBuffer beyond JVM limitations (Ian Friedman)
HBASE-15100 Master WALProcs still never clean up (Matteo Bertozzi)
HBASE-15125 HBaseFsck's adoptHdfsOrphan function creates region with wrong end key boundary (chenrongwei)
HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang)
HBASE-13318 RpcServer.getListenerAddress should handle when the accept channel is closed (Andrew Purtell)
HBASE-14535 Integration test for rpc connection concurrency / deadlock testing (Enis Soztutar)
HBASE-15636 hard coded wait time out value in HBaseTestingUtility#waitUntilAllRegionsAssigned might cause test failure (Stephen Yuan Jiang)
HBASE-14407 NotServingRegion: hbase region closed forever (Shuaifeng Zhou)
HBASE-14307 Incorrect use of positional read api in HFileBlock (Chris Nauroth)
HBASE-14963 Remove Guava dependency from HBase client code (ddas)
HBASE-14947 WALProcedureStore improvements (Matteo Bertozzi)
HBASE-14843 TestWALProcedureStore.testLoad is flakey (Matteo Bertozz)
HBASE-14712 Increase MasterProcWALs clean up granularity (Matteo Bertozzi)
HBASE-14449 Rewrite deadlock prevention for concurrent connection close
HBASE-14258 Make region_mover.rb script case insensitive with regard to hostname
HBASE-14269 FuzzyRowFilter omits certain rows when multiple fuzzy key exist
HBASE-14313 After a Connection sees ConnectionClosingException it never recovers (Elliott Clark)
HBASE-14302 TableSnapshotInputFormat should not create back references when restoring snapshot
BUG-45027/BUG-45361 Fix hostname used with Kerberos on Dual-Homed clusters.
HBASE-14536 Balancer & SSH interfering with each other leading to unavailability
HBASE-14680 Two configs for snapshot timeout and better defaults
HBASE-14283 Reverse scan doesn’t work with HFile inline index/bloom blocks
HBASE-15221 Reload the cache on re-tried puts in HTableMultiplexer and adds a close() method to HTableMultiplexer
HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
HBASE-15518 Add per-table metrics
HBASE-15519 Add per-user metrics
HBASE-14850 C++ client implementation (TECH PREVIEW. DO NOT DEPLOY IN PROD)
HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles
HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job
HBASE-14667 HBaseFsck constructors have diverged (Matteo)
HBASE-15292 Refined ZooKeeperWatcher to prevent ZooKeeper's callback while construction (Hiroshi Ikeda)
HBASE-15767 upgrade httpclient to 4.3.6
HBASE-15817 Backup history should mention the type (full or incremental) of the backup
HBASE-15808 Reduce potential bulk load intermediate space usage and waste (Jerry He)
HBASE-15842 SnapshotInfo should display ownership information
HBASE-15858 Some region server group shell commands don't work
HBASE-15880 RpcClientImpl#tracedWriteRequest incorrectly closes HTrace span (Mikhail)
HBASE-14906 Improvements on FlushLargeStoresPolicy (Yu Li)
HBASE-15873 ACL for snapshot restore / clone is not enforced
HBASE-14655 Narrow the scope of doAs() calls to region observer notifications for compaction
HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov)
HBASE-15904 Use comma as separator for list of tables in BackupInfo
HBASE-14123 HBase Backup/Restore Phase 2
HBASE-14140 HBase Backup Admin API
HBASE-15861 Add support for table sets in restore operation
HBASE-15928 hbase backup delete command does not remove backup root dir from hdfs
HBASE-15931 Add log for long-running tasks in AsyncProcess (Yu Li)
HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize()
HBASE-15019 Replication stuck when HDFS is restarted (Matteo)
HBASE-15972 hbase backup set command should not accept non-existing table
HBASE-15899 HBase incremental restore should handle namespaces properly
HBASE-15953 HBase backup set list command does not list any existing sets
HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer
HBASE-16006 FileSystem should be obtained from specified path in WALInputFormat#getSplits()
HBASE-15142 Procedure v2 - Basic WebUI listing the procedures (Matteo)
HBASE-15144 Procedure v2 - Web UI displaying Store state
HBASE-15862 Backup - Delete- Restore does not restore deleted data
HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 (Stack)
HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage
HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC)
HBASE-14805 status should show the master in shell (Enis)
HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty
HBASE-16064 delete backup command shows HDFS permission error when deleting the intended backup
HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang)
HBASE-14818 user_permission does not list namespace permissions (li xiang)
HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov)
HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang)
HBASE-16088 hbase restore gives a misleading message if the table doesn't exist
HBASE-14172 Upgrade existing thrift binding using thrift 0.9.3 compiler (Josh Elser)
HBASE-16037 Backup/Restore: Make automatic mode default one (Vladimir Rodionov)
HBASE-16065 hbase backup set describe command does not inform if the set does not exist (Vladimir Rodionov)
HBASE-16052 Improve HBaseFsck Scalability (Ben Lau)
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files
HBASE-16314 Retry on table snapshot failure
HBASE-16358 Backup create command: log success/failure with backup id
HBASE-13829 Add more ThrottleType (Guanghao Zhang)
HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang)
HBASE-16319 Fix TestCacheOnWrite after HBASE-16288 (Andrew Purtell)
HBASE-16267 Remove commons-httpclient dependency from hbase-rest module
HBASE-16359 NullPointerException in RSRpcServices.openRegion()
HBASE-16315 RegionSizeCalculator prints region names as binary without escapes
HBASE-16350 Undo server abort from HBASE-14968
HBASE-16367 Race between master and region server initialization may lead to premature server abort
HBASE-16377 ServerName check is ineffective in region_mover.rb
Following are the changes on top of Apache HBase 1.1.1
HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov)
HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled
HBASE-14471 Thrift - HTTP Error 413 full HEAD if using kerberos authentication
HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags (Jonathan Hsieh)
HBASE-14761 Deletes with and without visibility expression do not delete the matching mutation (Ram)
HBASE-14575 Relax region read lock for compactions
HBASE-15022 replication_admin.rb throws undefined method 'getZooKeeperClusterKey' for ZKUtil (Matteo)
HBASE-14866 VerifyReplication should use peer configuration in peer connection (Gary Helmling)
HBASE-14928 Start row should be set for query through HBase REST gateway involving globbing option
HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance (Elliott Clark)
HBASE-14432 Procedure V2 - enforce ACL on procedure admin tasks (Stephen Yuan Jiang)
HBASE-14488 Procedure V2 - shell command to abort a procedure (Stephen Yuan Jiang)
HBASE-14487 Procedure V2 - shell command to list all procedures (Stephen Yuan Jiang)
HBASE-14107 Procedure V2 - Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang)
HBASE-14108 Procedure V2 - Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang)
HBASE-14445 ExportSnapshot does not honor -chmod option
HBASE-13250 chown of ExportSnapshot does not cover all path and files (He Liangliang)
HBASE-14280 Bulk Upload from HA cluster to remote HA hbase cluster fails (Ankit Singhal)
HBASE-14497 Reverse Scan threw StackOverflow caused by readPt checking (Yerui Sun)
HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag
HBASE-14359 HTable#close will hang forever if unchecked error/exception thrown in AsyncProcess#sendMultiAction
HBASE-14342 Recursive call in RegionMergeTransactionImpl.getJournal()
HBASE-14314 Metrics for block cache should take region replicas into account
HBASE-13103 [ergonomics] add region size balancing as a feature of master (Mikhail Antonov)
HBASE-14367 Add normalization support to shell (Mikhail Antonov)
HBASE-14578 URISyntaxException during snapshot restore for table with user defined namespace
HBASE-14581 Znode cleanup throws auth exception in secure mode
HBASE-14565 Make ZK connection timeout configurable in MiniZooKeeperCluster
HBASE-14591 Region with reference hfile may split after a forced split in IncreasingToUpperBoundRegionSplitPolicy (Shaohui Liu)
HBASE-14361 ReplicationSink should create Connection instances lazily
HBASE-14621 ReplicationLogCleaner stuck on RS crash (Ashu)
HBASE-14624 BucketCache.freeBlock is too expensive
HBASE-14475 Region split requests are always audited with hbase user rather than request user
HBASE-14605 Split fails due to 'No valid credentials' error when SecureBulkLoadEndpoint#start tries to access hdfs
HBASE-14759 Avoid using Math.abs when selecting SyncRunner in FSHLog
HBASE-14268 Improve KeyLocker (Hiroshi Ikeda)
HBASE-14706 RegionLocationFinder should return multiple servernames by top host (Guanghao Zhang)
HBASE-14463 Severe performance downgrade when parallel reading a single key from BucketCache (Yu Li)
HBASE-14631 Region merge request should be audited with request user through proper scope of doAs() calls to region observer notifications
HBASE-14809 Grant / revoke Namespace admin permission to group
HBASE-14788 Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region
HBASE-14207 Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry (Pankaj Kumar)
HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor
HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException
HBASE-14799 Commons-collections object deserialization remote command execution vulnerability (Andrew Purtell)
HBASE-14632 Region server aborts due to unguarded dereference of Reader
HBASE-11658 Piped commands to hbase shell should return non-zero if shell command failed
HBASE-11940 Add utility scripts for snapshotting / restoring all tables in cluster
BUG-35784 Update httpcore version to 4.2.5
BUG-28682 HBase - Address Security Issues in Jetty 6.1.26
BUG-22418 Update jackson version to 1.9.13
BUG-29025 Windows incompatibility with unicode (Chinese characters)
HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level
HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi)
HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi)
HBASE-14493 Upgrade the jamon-runtime dependency (Andrew Purtell)
HBASE-14110 Add CostFunction for balancing primary region replicas
HBASE-15439 getMaximumAllowedTimeBetweenRuns in ScheduledChore ignores the TimeUnit (Jingcheng)
HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang)
HBASE-15234 Don't abort ReplicationLogCleaner on ZooKeeper errors (Gary)
HBASE-15181 A simple implementation of date based tiered compaction (Clara)
HBASE-15389 Write out multiple files when compaction (Duo Zhang)
HBASE-15085 IllegalStateException was thrown when scanning on bulkloaded HFiles
HBASE-14812 Fix ResultBoundedCompletionService deadlock (Elliott Clark)
HBASE-15252 Data loss when replaying WAL if HDFS timeout (Matteo)
HBASE-15400 Use DateTieredCompactor for Date Tiered Compaction (Clara Xiong)
HBASE-15187 Integrate CSRF prevention filter to REST gateway
HBASE-14347 Add a switch to DynamicClassLoader to disable it (huaxiang sun)
HBASE-15578 Handle HBASE-15234 for ReplicationHFileCleaner (Ashish)
HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop)
HBASE-15213 Fix increment performance regression caused by HBASE-8763 on branch-1.0 (Junegunn Choi)
HBASE-14380 Correct data gets skipped along with bad data in importTsv bulk load thru TsvImporterTextMapper (Bhupendra Kumar Jain)
HBASE-14229 Flushing canceled by coprocessor still leads to memstoreSize set down (Yerui Sun)
HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation
HBASE-11339 HBase MOB (Jingcheng Du)
HBASE-15527 Refactor Compactor related classes (Duo Zhang)
HBASE-14030 HBase Backup/Restore Phase 1 with Proc V2
HBASE-15592 Print Procedure WAL content (Jerry He)
HBASE-14674 Rpc handler / task monitoring seems to be broken after 0.98 (Heng Chen)
HBASE-14941 locate_region shell command (Matteo)
HBASE-15621 Suppress Hbase SnapshotHFile cleaner error messages when a snaphot is going on (Huaxiang)
HBASE-15622 Superusers does not consider the keytab credentials (Matteo)
HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil)
HBASE-15665 Support using different StoreFileComparators for different CompactionPolicies (Duo Zhang)
HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho)
HBASE-15679 Assertion on wrong variable in TestReplicationThrottler#testThrottling
HBASE-15669 HFile size is not considered correctly in a replication request (Ashish)
HBASE-14252 RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0
HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache (Heng Chen)
HBASE-15719 TestMasterCoprocessorExceptionWithAbort#testExceptionFromCoprocessorWhenCreatingTable fails due to premature master abortion
HBASE-15707 ImportTSV bulk output does not support tags with hfile.format.version=3 (huaxiang sun)
HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig)
HBASE-13590 TestEnableTableHandler.testEnableTableWithNoRegionServers is flakey
HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state