Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test a pr. #1

Open
wants to merge 116 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
116 commits
Select commit Hold shift + click to select a range
2bd72d6
Improve query performance in the AggregationIterator by calling
manolama Jun 6, 2015
7318167
Merge remote-tracking branch 'OFFICIAL/master'
manolama Jun 6, 2015
6559cb7
Merge remote-tracking branch 'OFFICIAL/master'
manolama Aug 30, 2015
ef22de8
Bump AsyncHBase to the release version and remove old md5s
manolama Sep 12, 2015
6cb7637
Merge remote-tracking branch 'OFFICIAL/master'
manolama Sep 12, 2015
a30211c
Release 2.1.1
manolama Sep 12, 2015
8e7eb32
Pull in the updated NEWS and THANKS files
manolama Sep 12, 2015
5388ff3
Cut 2.2.0 RC1
manolama Sep 12, 2015
611c870
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Sep 26, 2015
93b3798
Add the Exceptions utility class for parsing out deferred group
manolama Sep 26, 2015
5fc5179
Add the QueryUtil class that pulls some methods out of the TsdbQuery
manolama Sep 26, 2015
6bc6b3f
Fix for #568, modifying the /api/search/lookup method to properly
manolama Sep 26, 2015
fcb2f72
Fix up the search API for lookups to be fully asynchronous. Thanks
manolama Sep 27, 2015
52ee82e
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Oct 4, 2015
7681bc3
Bump the AsyncHBase version to 1.7.1-SNAPSHOT to fix decoding bugs
manolama Oct 4, 2015
5cc9e65
Version to 2.2.0RC2-SNAPSHOT
manolama Oct 4, 2015
b5272ee
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Oct 5, 2015
674e290
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Oct 11, 2015
5d2479c
Fix test dependencies where DeleteRequest was pulled from Zookeeper
manolama Oct 27, 2015
aaee2ba
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Oct 28, 2015
384aaf9
s/space/comma/ in instruction for specifying ZooKeeper quorum
Oct 28, 2015
f0713e6
Merge remote-tracking branch 'OFFICIAL/master'
manolama Oct 28, 2015
5933ac2
s/space/comma/ in instruction for specifying ZooKeeper quorum
Oct 28, 2015
2e5a6ac
Merge remote-tracking branch 'OFFICIAL/master'
manolama Oct 28, 2015
6f8494b
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Oct 28, 2015
fcaf2d4
remove debug log with wrong INFO level to save disk space
Dieken Oct 23, 2015
99f9abe
QueryUi: URL.decode() url/query string before use
jwestfall69 Oct 20, 2015
601209b
fix stuck metasync when salting is enabled
Dieken Oct 29, 2015
c6ed6f6
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Nov 4, 2015
b7602d7
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Nov 9, 2015
4111c06
Fix IncomingDataPoint toString, separate tags with space
louxiu Nov 9, 2015
c78b8c5
Merge remote-tracking branch 'OFFICIAL/master'
manolama Nov 10, 2015
ec783c6
Release 2.2.0RC2.
manolama Oct 9, 2015
5c6946e
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Nov 10, 2015
6d151e3
Release 2.1.3 to fix the static file bug copying introduced in
manolama Nov 11, 2015
f9636a0
Merge remote-tracking branch 'OFFICIAL/master'
manolama Nov 21, 2015
ad0ccad
Silence stray logging output in TSMeta.call()
vitaliyf Nov 21, 2015
2fc21f1
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Nov 29, 2015
82effbd
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Nov 30, 2015
eab9709
A couple of additional UTs for TSSubQuery
manolama Dec 15, 2015
08abaac
Merge remote-tracking branch 'OFFICIAL/master'
manolama Dec 15, 2015
1279d45
Fix #642 by sorting the tags properly on the bytes, NOT the string
manolama Dec 15, 2015
8507c6c
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Dec 16, 2015
a182462
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Dec 17, 2015
87b4933
Fix case on the new UI header filename.
manolama Dec 17, 2015
c865a3e
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Jan 26, 2016
a6dbb75
Fix up the Makefile for debian creation with the updated UI files
manolama Jan 26, 2016
38f6732
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Jan 30, 2016
af8581d
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Feb 1, 2016
ce2b71e
Merge remote-tracking branch 'OFFICIAL/master'
manolama Feb 1, 2016
c5dfac8
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Feb 3, 2016
a9e463a
Set tsd.query.allow_simultaneous_duplicates = true by default.
manolama Feb 3, 2016
9fcb370
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Feb 5, 2016
9a36e67
Bump to AsyncHbase 1.7.1 release
manolama Feb 13, 2016
4fc6f52
Add a try/catch to the FSCK utility to log problems found when
manolama Nov 21, 2015
5d897f5
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Feb 13, 2016
27c54b2
Update the logback.xml config file with disabled configs for the
manolama Feb 14, 2016
5577f7e
Rollback 6d2102af7d7391b759698979cab9ae74bea15d80 as I was mistaken
manolama Feb 14, 2016
333046d
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Feb 14, 2016
c0612fc
Cut 2.2.0
manolama Feb 14, 2016
fb453a5
Cut 2.1.4
manolama Feb 14, 2016
9b5e56d
Merge remote-tracking branch 'OFFICIAL/master'
manolama Feb 14, 2016
a61772f
Merge remote-tracking branch 'OFFICIAL/next' into next
manolama Feb 14, 2016
afc5180
Merge branch 'next'
manolama Feb 14, 2016
f49d5d3
Fix
manolama Feb 14, 2016
3be2e63
Add HBase appends and iddle connections closed stats.
manolama Feb 21, 2016
90b8fec
Merge remote-tracking branch 'OFFICIAL/master'
manolama Feb 23, 2016
f3badad
Merge remote-tracking branch 'OFFICIAL/master'
manolama Feb 28, 2016
370650e
Merge remote-tracking branch 'OFFICIAL/master'
manolama Apr 18, 2016
1c73ea8
Add comments and UTs to 931242b5db4f8ab79c0346d876c53cc96349ba3d
manolama Apr 18, 2016
e1140c7
Fix TSDB write data around the TSMeta and TSUID incrementation.
manolama Apr 19, 2016
4087cd1
Bump to 2.2.1-SNAPSHOT
manolama Apr 19, 2016
9f6a585
Fix the filter metric and tag resolution chain by making sure the
manolama Apr 19, 2016
049cbf0
Merge remote-tracking branch 'OFFICIAL/master'
manolama Apr 19, 2016
4c2fd43
Add TagVFilter.getCopy() for creating a duplicate of the filter.
manolama Apr 19, 2016
07ff47e
Fix #773 - Add global_annotations to graphs
HugoMFernandes Apr 15, 2016
667fccf
Add annotation flags to the UI to pass URI params properly for
manolama Apr 23, 2016
8874bac
Merge remote-tracking branch 'OFFICIAL/master'
manolama May 1, 2016
27bb483
Fix comment for behavior of tsd.network.tcp_no_delay
kev009 Apr 25, 2016
4c98026
A few fixes for deb and rpm opentsdb.conf options
kev009 Apr 25, 2016
b24eccf
Merge remote-tracking branch 'OFFICIAL/master'
manolama May 1, 2016
a4cc4fc
Fix issue #778 by allowing the creating of a TSMeta object without
manolama May 1, 2016
050d507
Fix issue #784 by adding an estimate for the number of data points
manolama May 1, 2016
6d011d5
f
manolama May 1, 2016
ef4905a
Merge remote-tracking branch 'OFFICIAL/master'
manolama Jul 13, 2016
21df40d
Merge remote-tracking branch 'OFFICIAL/master'
manolama Sep 17, 2016
7d2f7a9
Move to AsyncHBase 1.7.2
manolama Sep 17, 2016
b1fe8fc
Merge remote-tracking branch 'OFFICIAL/master'
manolama Oct 8, 2016
d6a7405
Merge remote-tracking branch 'OFFICIAL/master'
manolama Oct 15, 2016
3665794
Merge remote-tracking branch 'OFFICIAL/master'
manolama Dec 31, 2016
ef35ae2
Modify the config loads for the RPCManager class to use the config's
manolama Dec 31, 2016
4728986
Avoid double computing the expressions for the /query/exp endpoint.
manolama Jan 28, 2017
cedd46e
Bump javassist to 3.21.0-GA
goll Feb 1, 2017
b665eaf
Merge remote-tracking branch 'OFFICIAL/master'
manolama Mar 11, 2017
97bdd3c
Fix #915 by simply copying the entire tools directory into the
manolama Mar 11, 2017
4cbfbc7
Merge remote-tracking branch 'OFFICIAL/master'
manolama Apr 30, 2017
be2b995
Log query stats in case of Closed Channel also
jsbali May 2, 2017
e7ccbfd
added java-8-oracle PATH in JDK_DIRS
ioanszilagyi Apr 12, 2017
f31916e
Pass FAMILY to get().
alienth Mar 11, 2017
58e6c72
Fix spotted incorrect conditional.
Jan 23, 2017
e05923f
Merge remote-tracking branch 'OFFICIAL/master'
manolama Jun 11, 2017
e918e8f
Fix #994 by filtering on the annotation start time when serializing
manolama Jun 11, 2017
e7ff2fb
Fix #967 by changing the conversions to UTF-8 for the static byte met…
manolama Jun 12, 2017
c5379e3
Take a stab at fixing #953 by at least hunting for back-ticks before …
manolama Jun 12, 2017
11958ab
Bump AsyncHBase client to 1.8.0 for HBase 1.3.x compat.
manolama Jun 12, 2017
f88236e
Merge remote-tracking branch 'OFFICIAL/master'
manolama Jul 8, 2017
8e0ebf0
Remove the "final" modifier from the meta classes (TSMeta, UIDMeta and
manolama Jul 16, 2017
e33410f
Merge remote-tracking branch 'OFFICIAL/master'
manolama Jan 31, 2018
212d4f8
Try screwdriver.
manolama Feb 8, 2018
6f380a5
Fix SD
manolama Feb 8, 2018
804ea58
Doh, missed period
manolama Feb 8, 2018
3ae0816
Install autoconf?
manolama Feb 8, 2018
9d3cc9a
SD didn't like init
manolama Feb 8, 2018
6b17459
Now it sets up the docker
manolama Feb 8, 2018
a19db84
Fail a ut
manolama Feb 9, 2018
a7fd85c
Test a pr.
manolama Feb 9, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 0 additions & 9 deletions .travis.yml

This file was deleted.

7 changes: 7 additions & 0 deletions screwdriver.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
shared:
image: maven

jobs:
main:
steps:
- run_arbitrary_script: apt-get update && apt-get install autoconf make -y && ./build.sh pom.xml && mvn clean test --quiet
1 change: 1 addition & 0 deletions src/core/TSDB.java
Original file line number Diff line number Diff line change
Expand Up @@ -782,6 +782,7 @@ public Histogram getScanLatencyHistogram() {
*/
private static void collectUidStats(final UniqueId uid,
final StatsCollector collector) {
System.out.println("Just testing prs.");
collector.record("uid.cache-hit", uid.cacheHits(), "kind=" + uid.kind());
collector.record("uid.cache-miss", uid.cacheMisses(), "kind=" + uid.kind());
collector.record("uid.cache-size", uid.cacheSize(), "kind=" + uid.kind());
Expand Down
21 changes: 8 additions & 13 deletions src/tools/CliUtils.java
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,6 @@ final class CliUtils {
static final Method toBytes;
/** Function used to convert a byte[] to a String. */
static final Method fromBytes;
/** Charset used to convert Strings to byte arrays and back. */
static final Charset CHARSET;
/** The single column family used by this class. */
static final byte[] ID_FAMILY;
/** The single column family used by this class. */
Expand All @@ -58,9 +56,6 @@ final class CliUtils {
// "THIS IS INTERNAL DO NOT USE". If only Java had C++'s "friend" or
// a less stupid notion of a package.
Field f;
f = uidclass.getDeclaredField("CHARSET");
f.setAccessible(true);
CHARSET = (Charset) f.get(null);
f = uidclass.getDeclaredField("ID_FAMILY");
f.setAccessible(true);
ID_FAMILY = (byte[]) f.get(null);
Expand All @@ -79,17 +74,17 @@ final class CliUtils {
}
}
/** Qualifier for metrics meta data */
static final byte[] METRICS_META = "metric_meta".getBytes(CHARSET);
static final byte[] METRICS_META = "metric_meta".getBytes(Const.ASCII_CHARSET);
/** Qualifier for tagk meta data */
static final byte[] TAGK_META = "tagk_meta".getBytes(CHARSET);
static final byte[] TAGK_META = "tagk_meta".getBytes(Const.ASCII_CHARSET);
/** Qualifier for tagv meta data */
static final byte[] TAGV_META = "tagv_meta".getBytes(CHARSET);
static final byte[] TAGV_META = "tagv_meta".getBytes(Const.ASCII_CHARSET);
/** Qualifier for metrics UIDs */
static final byte[] METRICS = "metrics".getBytes(CHARSET);
static final byte[] METRICS = "metrics".getBytes(Const.ASCII_CHARSET);
/** Qualifier for tagk UIDs */
static final byte[] TAGK = "tagk".getBytes(CHARSET);
static final byte[] TAGK = "tagk".getBytes(Const.ASCII_CHARSET);
/** Qualifier for tagv UIDs */
static final byte[] TAGV = "tagv".getBytes(CHARSET);
static final byte[] TAGV = "tagv".getBytes(Const.ASCII_CHARSET);

/**
* Returns the max metric ID from the UID table
Expand All @@ -103,8 +98,8 @@ static long getMaxMetricID(final TSDB tsdb) {
// first up, we need the max metric ID so we can split up the data table
// amongst threads.
final GetRequest get = new GetRequest(tsdb.uidTable(), new byte[] { 0 });
get.family("id".getBytes(CHARSET));
get.qualifier("metrics".getBytes(CHARSET));
get.family("id".getBytes(Const.ASCII_CHARSET));
get.qualifier("metrics".getBytes(Const.ASCII_CHARSET));
ArrayList<KeyValue> row;
try {
row = tsdb.getClient().get(get).joinUninterruptibly();
Expand Down
3 changes: 2 additions & 1 deletion src/tools/UidManager.java
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@
import org.hbase.async.PutRequest;
import org.hbase.async.Scanner;

import net.opentsdb.core.Const;
import net.opentsdb.core.TSDB;
import net.opentsdb.meta.TSMeta;
import net.opentsdb.uid.NoSuchUniqueId;
Expand Down Expand Up @@ -300,7 +301,7 @@ private static int grep(final HBaseClient client,
if (ignorecase) {
regexp = "(?i)" + regexp;
}
scanner.setKeyRegexp(regexp, CliUtils.CHARSET);
scanner.setKeyRegexp(regexp, Const.ASCII_CHARSET);
boolean found = false;
try {
ArrayList<ArrayList<KeyValue>> rows;
Expand Down
9 changes: 5 additions & 4 deletions src/tsd/RpcManager.java
Original file line number Diff line number Diff line change
Expand Up @@ -252,11 +252,12 @@ private void initializeBuiltinRpcs(final String mode,
final ImmutableMap.Builder<String, TelnetRpc> telnet,
final ImmutableMap.Builder<String, HttpRpc> http) {

final Boolean enableApi = tsdb.getConfig().getString("tsd.core.enable_api").equals("true");
final Boolean enableUi = tsdb.getConfig().getString("tsd.core.enable_ui").equals("true");
final Boolean enableDieDieDie = tsdb.getConfig().getString("tsd.no_diediedie").equals("false");
final boolean enableApi = tsdb.getConfig().getBoolean("tsd.core.enable_api");
final boolean enableUi = tsdb.getConfig().getBoolean("tsd.core.enable_ui");
final boolean enableDieDieDie = tsdb.getConfig().getBoolean("tsd.no_diediedie");

LOG.info("Mode: {}, HTTP UI Enabled: {}, HTTP API Enabled: {}", mode, enableUi, enableApi);
LOG.info("Mode: {}, HTTP UI Enabled: {}, HTTP API Enabled: {}", mode,
enableUi, enableApi);

if (mode.equals("rw") || mode.equals("wo")) {
final PutDataPointRpc put = new PutDataPointRpc();
Expand Down
15 changes: 6 additions & 9 deletions src/uid/UniqueId.java
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,6 @@
// see <http://www.gnu.org/licenses/>.
package net.opentsdb.uid;

import java.nio.charset.Charset;
import java.util.ArrayList;
import java.util.Arrays;
import java.util.Collections;
Expand Down Expand Up @@ -65,8 +64,6 @@ public enum UniqueIdType {
TAGV
}

/** Charset used to convert Strings to byte arrays and back. */
private static final Charset CHARSET = Charset.forName("ISO-8859-1");
/** The single column family used by this class. */
private static final byte[] ID_FAMILY = toBytes("id");
/** The single column family used by this class. */
Expand Down Expand Up @@ -1260,11 +1257,11 @@ private void hbasePutWithRetry(final PutRequest put, short attempts, short wait)
}

private static byte[] toBytes(final String s) {
return s.getBytes(CHARSET);
return s.getBytes(Const.UTF8_CHARSET);
}

private static String fromBytes(final byte[] b) {
return new String(b, CHARSET);
return new String(b, Const.UTF8_CHARSET);
}

/** Returns a human readable string representation of the object. */
Expand Down Expand Up @@ -1588,21 +1585,21 @@ public Map<String, Long> call(final ArrayList<KeyValue> row)
// and the user hasn't put any metrics in, so log and return 0s
LOG.info("Could not find the UID assignment row");
for (final byte[] kind : kinds) {
results.put(new String(kind, CHARSET), 0L);
results.put(new String(kind, Const.ASCII_CHARSET), 0L);
}
return results;
}

for (final KeyValue column : row) {
results.put(new String(column.qualifier(), CHARSET),
results.put(new String(column.qualifier(), Const.ASCII_CHARSET),
Bytes.getLong(column.value()));
}

// if the user is starting with a fresh UID table, we need to account
// for missing columns
for (final byte[] kind : kinds) {
if (results.get(new String(kind, CHARSET)) == null) {
results.put(new String(kind, CHARSET), 0L);
if (results.get(new String(kind, Const.ASCII_CHARSET)) == null) {
results.put(new String(kind, Const.ASCII_CHARSET), 0L);
}
}
return results;
Expand Down
7 changes: 6 additions & 1 deletion test/core/TestSpan.java
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,12 @@ public void before() throws Exception {
when(RowKey.metricNameAsync(tsdb, HOUR1))
.thenReturn(Deferred.fromResult("sys.cpu.user"));
}


@Test
public void failme() {
assertTrue(false);
}

@Test
public void addRow() {
final byte[] qual1 = { 0x00, 0x07 };
Expand Down