Package org.apache.hadoop.hbase.regionserver.querymatcher

Class TestUserScanQueryMatcher

java.lang.Object

org.apache.hadoop.hbase.regionserver.querymatcher.AbstractTestScanQueryMatcher

org.apache.hadoop.hbase.regionserver.querymatcher.TestUserScanQueryMatcher

@Tag("org.apache.hadoop.hbase.testclassification.RegionServerTests") @Tag("org.apache.hadoop.hbase.testclassification.SmallTests")
public class TestUserScanQueryMatcher
extends AbstractTestScanQueryMatcher

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	TestUserScanQueryMatcher.AlwaysIncludeAndSeekNextRowFilter
private static class	TestUserScanQueryMatcher.AlwaysIncludeFilter
private static class	TestUserScanQueryMatcher.FixedSkipHintFilter

Field Summary

Fields

Modifier and Type	Field	Description
private static final org.slf4j.Logger	LOG

Fields inherited from class org.apache.hadoop.hbase.regionserver.querymatcher.AbstractTestScanQueryMatcher

col1, col2, col3, col4, col5, conf, data, fam1, fam2, get, row1, row2, row3, rowComparator, scan, ttl

Constructor Summary

Constructors

Constructor	Description
TestUserScanQueryMatcher()

Method Summary

Modifier and Type	Method	Description
private void	assertAllSkip(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells, org.apache.hadoop.hbase.KeyValue.Type type, int count)	All markers should SKIP regardless of count.
private void	assertSeekAfterThreshold(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells, org.apache.hadoop.hbase.KeyValue.Type type, int n)	First n-1 markers SKIP, n-th triggers SEEK_NEXT_COL.
private org.apache.hadoop.hbase.regionserver.querymatcher.UserScanQueryMatcher	createDeleteMatcher(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells)
void	testDeleteColumnDifferentQualifiersDoNotSeek()	DeleteColumn markers for different qualifiers should not accumulate the seek counter.
void	testDeleteColumnEmptyQualifierDoesNotSkipDeleteFamily()	DeleteColumn with empty qualifier must not cause seeking past a subsequent DeleteFamily.
void	testMatch_ExpiredExplicit()	Verify that ScanQueryMatcher only skips expired KeyValue instances and does not exit early from the row (skipping later non-expired KeyValues).
void	testMatch_ExpiredWildcard()	Verify that ScanQueryMatcher only skips expired KeyValue instances and does not exit early from the row (skipping later non-expired KeyValues).
void	testMatch_Wildcard()
void	testMatchExplicitColumns()
void	testMatchWhenFilterReturnsIncludeAndSeekNextRow()
void	testMergeFilterResponseCase1()	Here is the unit test for UserScanQueryMatcher#mergeFilterResponse, when the number of cells exceed the versions requested in scan, we should return SEEK_NEXT_COL, but if current match code is INCLUDE_AND_SEEK_NEXT_ROW, we can optimize to choose the max step between SEEK_NEXT_COL and INCLUDE_AND_SEEK_NEXT_ROW, which is SEEK_NEXT_ROW.
void	testMergeFilterResponseCase2()	Here is the unit test for UserScanQueryMatcher#mergeFilterResponse: the match code may be changed to SEEK_NEXT_COL or INCLUDE_AND_SEEK_NEXT_COL after merging with filterResponse, even if the passed match code is neither SEEK_NEXT_COL nor INCLUDE_AND_SEEK_NEXT_COL.
void	testNeverIncludeFakeCell()	This is a cryptic test.
void	testNormalFilterCellHintPathUnaffectedBySkipHintChange()	Verify that the normal filterCell/getNextCellHint path is unaffected by pendingSkipHint.
void	testNullSkipHintFallsThroughToOriginalCodeOnTimeRangeGate()	Verify that a null getSkipHint falls back to the original SKIP match code.
void	testPendingSkipHintClearedOnRowTransition()	Verify that pendingSkipHint is cleared when a row transition occurs via setToNewRow.
void	testSeekOnRangeDelete()	After enough consecutive range delete markers, the matcher should switch from SKIP to SEEK_NEXT_COL.
void	testSeekOnRangeDeleteOutsideTimeRange()	Delete markers outside the scan's time range (includeDeleteMarker=false) should still accumulate the seek counter and trigger SEEK_NEXT_COL after the threshold.
void	testSkipHintConsultedForCellNewerThanTimeRange()	Verify that getSkipHint is consulted when a cell is newer than the time-range upper bound.
void	testSkipHintConsultedForCellOlderThanTimeRange()	Verify that getSkipHint is consulted when a cell is older than the time-range lower bound.
void	testSkipHintConsultedForExcludedColumn()	Verify that getSkipHint is consulted when a column is excluded by the scan's column set.
void	testSkipHintConsultedForReversedScan()	Verify that getSkipHint works correctly for reversed scans (hint must be smaller).
void	testSkipHintConsultedOnVersionExhaustion()	Verify that getSkipHint is consulted when the version limit is exhausted.

Methods inherited from class org.apache.hadoop.hbase.regionserver.querymatcher.AbstractTestScanQueryMatcher

setUp

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

Constructor Details

TestUserScanQueryMatcher

public TestUserScanQueryMatcher()

Method Details

testNeverIncludeFakeCell

@Test
public void testNeverIncludeFakeCell()
                              throws IOException

This is a cryptic test. It is checking that we don't include a fake cell. See HBASE-16074 for background.

Throws:

IOException

testMatchExplicitColumns

@Test
public void testMatchExplicitColumns()
                              throws IOException

Throws:

IOException

testMatch_Wildcard

@Test
public void testMatch_Wildcard()
                        throws IOException

Throws:

IOException

testMatch_ExpiredExplicit

@Test
public void testMatch_ExpiredExplicit()
                               throws IOException

Verify that ScanQueryMatcher only skips expired KeyValue instances and does not exit early from the row (skipping later non-expired KeyValues). This version mimics a Get with explicitly specified column qualifiers.

Throws:

IOException

testMatch_ExpiredWildcard

@Test
public void testMatch_ExpiredWildcard()
                               throws IOException

Verify that ScanQueryMatcher only skips expired KeyValue instances and does not exit early from the row (skipping later non-expired KeyValues). This version mimics a Get with wildcard-inferred column qualifiers.

Throws:

IOException

testMatchWhenFilterReturnsIncludeAndSeekNextRow

@Test
public void testMatchWhenFilterReturnsIncludeAndSeekNextRow()
                                                     throws IOException

Throws:

IOException

testMergeFilterResponseCase1

@Test
public void testMergeFilterResponseCase1()
                                  throws IOException

Here is the unit test for UserScanQueryMatcher#mergeFilterResponse, when the number of cells exceed the versions requested in scan, we should return SEEK_NEXT_COL, but if current match code is INCLUDE_AND_SEEK_NEXT_ROW, we can optimize to choose the max step between SEEK_NEXT_COL and INCLUDE_AND_SEEK_NEXT_ROW, which is SEEK_NEXT_ROW.

Throws:

IOException

testMergeFilterResponseCase2

@Test
public void testMergeFilterResponseCase2()
                                  throws Exception

Here is the unit test for UserScanQueryMatcher#mergeFilterResponse: the match code may be changed to SEEK_NEXT_COL or INCLUDE_AND_SEEK_NEXT_COL after merging with filterResponse, even if the passed match code is neither SEEK_NEXT_COL nor INCLUDE_AND_SEEK_NEXT_COL. In that case, we need to make sure that the ColumnTracker has been switched to the next column.
An effective test way is: we only need to check the cell from getKeyForNextColumn(). because that as long as the UserScanQueryMatcher returns SEEK_NEXT_COL or INCLUDE_AND_SEEK_NEXT_COL, UserScanQueryMatcher#getKeyForNextColumn should return an cell whose column is larger than the current cell's.

Throws:

Exception

testSkipHintConsultedForCellNewerThanTimeRange

@Test
public void testSkipHintConsultedForCellNewerThanTimeRange()
                                                    throws IOException

Verify that getSkipHint is consulted when a cell is newer than the time-range upper bound.

Throws:

IOException

testSkipHintConsultedForCellOlderThanTimeRange

@Test
public void testSkipHintConsultedForCellOlderThanTimeRange()
                                                    throws IOException

Verify that getSkipHint is consulted when a cell is older than the time-range lower bound.

Throws:

IOException

testNullSkipHintFallsThroughToOriginalCodeOnTimeRangeGate

@Test
public void testNullSkipHintFallsThroughToOriginalCodeOnTimeRangeGate()
                                                               throws IOException

Verify that a null getSkipHint falls back to the original SKIP match code.

Throws:

IOException

testSkipHintConsultedForExcludedColumn

@Test
public void testSkipHintConsultedForExcludedColumn()
                                            throws IOException

Verify that getSkipHint is consulted when a column is excluded by the scan's column set.

Throws:

IOException

testSkipHintConsultedOnVersionExhaustion

@Test
public void testSkipHintConsultedOnVersionExhaustion()
                                              throws IOException

Verify that getSkipHint is consulted when the version limit is exhausted.

Throws:

IOException

testPendingSkipHintClearedOnRowTransition

@Test
public void testPendingSkipHintClearedOnRowTransition()
                                               throws IOException

Verify that pendingSkipHint is cleared when a row transition occurs via setToNewRow.

Throws:

IOException

testNormalFilterCellHintPathUnaffectedBySkipHintChange

@Test
public void testNormalFilterCellHintPathUnaffectedBySkipHintChange()
                                                            throws IOException

Verify that the normal filterCell/getNextCellHint path is unaffected by pendingSkipHint.

Throws:

IOException

testSkipHintConsultedForReversedScan

@Test
public void testSkipHintConsultedForReversedScan()
                                          throws IOException

Verify that getSkipHint works correctly for reversed scans (hint must be smaller).

Throws:

IOException

testSeekOnRangeDelete

@Test
public void testSeekOnRangeDelete()
                           throws IOException

After enough consecutive range delete markers, the matcher should switch from SKIP to SEEK_NEXT_COL. Point deletes and KEEP_DELETED_CELLS always SKIP.

Throws:

IOException

testDeleteColumnEmptyQualifierDoesNotSkipDeleteFamily

@Test
public void testDeleteColumnEmptyQualifierDoesNotSkipDeleteFamily()
                                                           throws IOException

DeleteColumn with empty qualifier must not cause seeking past a subsequent DeleteFamily. DeleteFamily masks all columns, so it must be tracked by the delete tracker.

Throws:

IOException

testDeleteColumnDifferentQualifiersDoNotSeek

@Test
public void testDeleteColumnDifferentQualifiersDoNotSeek()
                                                  throws IOException

DeleteColumn markers for different qualifiers should not accumulate the seek counter. Only consecutive markers for the same qualifier should trigger seeking.

Throws:

IOException

testSeekOnRangeDeleteOutsideTimeRange

@Test
public void testSeekOnRangeDeleteOutsideTimeRange()
                                           throws IOException

Delete markers outside the scan's time range (includeDeleteMarker=false) should still accumulate the seek counter and trigger SEEK_NEXT_COL after the threshold.

Throws:

IOException

createDeleteMatcher

private org.apache.hadoop.hbase.regionserver.querymatcher.UserScanQueryMatcher createDeleteMatcher(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells)
                                                                                            throws IOException

Throws:

IOException

assertSeekAfterThreshold

private void assertSeekAfterThreshold(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells,
 org.apache.hadoop.hbase.KeyValue.Type type,
 int n)
                               throws IOException

First n-1 markers SKIP, n-th triggers SEEK_NEXT_COL.

Throws:

IOException

assertAllSkip

private void assertAllSkip(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells,
 org.apache.hadoop.hbase.KeyValue.Type type,
 int count)
                    throws IOException

All markers should SKIP regardless of count.

Throws:

IOException