what is this exception?

[Xiao Zhou]

2 nodes out of 10 have this exception and not available to client

2015-03-19 16:21:25,560 voldemort-niosocket-server4 ERROR voldemort.server.niosocket.AsyncRequestHandler -

java.lang.IllegalArgumentException

        at java.nio.ByteBuffer.allocate(ByteBuffer.java:330)

        at voldemort.store.readonly.chunk.ChunkedFileSet.readValue(ChunkedFileSet.java:587)

        at voldemort.store.readonly.ReadOnlyStorageEngine.get(ReadOnlyStorageEngine.java:523)

        at voldemort.store.readonly.ReadOnlyStorageEngine.get(ReadOnlyStorageEngine.java:56)

        at voldemort.store.invalidmetadata.InvalidMetadataCheckingStore.get(InvalidMetadataCheckingStore.java:109)

        at voldemort.store.invalidmetadata.InvalidMetadataCheckingStore.get(InvalidMetadataCheckingStore.java:41)

        at voldemort.store.DelegatingStore.get(DelegatingStore.java:65)

        at voldemort.store.stats.StatTrackingStore.get(StatTrackingStore.java:87)

        at voldemort.store.stats.StatTrackingStore.get(StatTrackingStore.java:40)

        at voldemort.store.DelegatingStore.get(DelegatingStore.java:65)

        at voldemort.store.quota.QuotaLimitingStore.get(QuotaLimitingStore.java:112)

        at voldemort.store.quota.QuotaLimitingStore.get(QuotaLimitingStore.java:35)

        at voldemort.server.protocol.vold.VoldemortNativeRequestHandler.handleGet(VoldemortNativeRequestHandler.java:312)

        at voldemort.server.protocol.vold.VoldemortNativeRequestHandler.handleRequest(VoldemortNativeRequestHandler.java:63)

        at voldemort.server.niosocket.AsyncRequestHandler.read(AsyncRequestHandler.java:132)

        at voldemort.common.nio.SelectorManagerWorker.run(SelectorManagerWorker.java:103)

        at voldemort.common.nio.SelectorManager.run(SelectorManager.java:214)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

voldemort version 1.8.6

 <store>

        <name>readonlyusers</name>

        <persistence>read-only</persistence>

        <routing>client</routing>

        <replication-factor>1</replication-factor>

        <required-reads>1</required-reads>

        <required-writes>1</required-writes>

        <key-serializer><type>string</type></key-serializer>

        <value-serializer>

            <type>protobuf</type>

            <schema-info>java=com.audiencescience.data.protobuf.UserProfile$Profile</schema-info>

        </value-serializer>

    </store>

node.id=8

bdb.cache.size=2GB

bdb.checkpoint.interval.bytes=2147483648

bdb.checkpointer.off.batch.writes=true

bdb.cleaner.interval.bytes=15728640

bdb.evict.by.level=true

bdb.lock.nLockTables=47

bdb.one.env.per.store=true

data.directory=/data/voldemort

enable.network.classloader=true

enable.server.routing=true

enable.verbose.logging=false

failuredetector.implementation=voldemort.cluster.failuredetector.BannagePeriodFailureDetector

http.enable=true

jmx.enable=true

metadata.directory=/var/rsi/voldemort/config

nio.connector.selectors=24

num.scan.permits=2

scheduler.threads=18

slop.frequency.ms=300000

socket.enable=true

storage.configs=voldemort.store.bdb.BdbStorageConfiguration, voldemort.store.readonly.ReadOnlyStorageConfiguration

stream.read.byte.per.sec=209715200

stream.write.byte.per.sec=78643200

readonly.backups=0

<cluster>

    <name>sess_cluster</name>

    <server>

        <id>0</id>

        <host>dc1-voldemort01.dc01.revsci.net</host>

        <http-port>8081</http-port>

        <socket-port>6666</socket-port>

        <admin-port>6667</admin-port>

        <partitions>0,10,20,30,40,50,60,70,80,90,100,110,120,130,140,150,160,170,180,190,200,210,220,230,240,250,260,270,280,290,300,310,320,330,340,350,360,370,380,390,400,410,420,430,440,450,460,470,480,490,500,510,520,530,540,550,560,570,580,590,600,610,620,630,640,650,660,670,680,690,700,710,720,730,740,750,760,770,780,790,800,810,820,830,840,850,860,870,880,890,900,910,920,930,940,950,960,970,980,990,1000,1010,1020,1030,1040,1050,1060,1070,1080,1090,1100,1110,1120,1130,1140,1150,1160,1170,1180,1190,1200,1210,1220,1230,1240,1250,1260,1270,1280,1290,1300,1310,1320,1330,1340,1350,1360,1370,1380,1390,1400,1410,1420,1430,1440,1450,1460,1470,1480,1490,1500,1510,1520,1530,1540,1550,1560,1570,1580,1590,1600,1610,1620,1630,1640,1650,1660,1670,1680,1690,1700,1710,1720,1730,1740,1750,1760,1770,1780,1790,1800,1810,1820,1830,1840,1850,1860,1870,1880,1890,1900,1910,1920,1930,1940,1950,1960,1970,1980,1990</partitions>

    </server>

    <server>

        <id>1</id>

....

[Xiao Zhou]

also this error after turn on debug:

2015-03-19 17:35:17,492 voldemort-niosocket-server15 INFO  voldemort.server.niosocket.AsyncRequestHandler - Protocol negotiated for Socket[addr=/10.6.1.21,port=24753,localport=6666]: voldemort-native-v1

2015-03-19 17:35:17,506 voldemort-niosocket-server15 ERROR voldemort.server.niosocket.AsyncRequestHandler - To offset (21561343) should be <= than length (21561342)

java.lang.IllegalArgumentException: To offset (21561343) should be <= than length (21561342)

        at voldemort.utils.ByteUtils.compare(ByteUtils.java:456)

        at voldemort.store.readonly.chunk.ChunkedFileSet.readValue(ChunkedFileSet.java:591)

        at voldemort.store.readonly.ReadOnlyStorageEngine.get(ReadOnlyStorageEngine.java:523)

        at voldemort.store.readonly.ReadOnlyStorageEngine.get(ReadOnlyStorageEngine.java:56)

        at voldemort.store.invalidmetadata.InvalidMetadataCheckingStore.get(InvalidMetadataCheckingStore.java:109)

        at voldemort.store.invalidmetadata.InvalidMetadataCheckingStore.get(InvalidMetadataCheckingStore.java:41)

        at voldemort.store.DelegatingStore.get(DelegatingStore.java:65)

        at voldemort.store.stats.StatTrackingStore.get(StatTrackingStore.java:87)

        at voldemort.store.stats.StatTrackingStore.get(StatTrackingStore.java:40)

        at voldemort.store.DelegatingStore.get(DelegatingStore.java:65)

        at voldemort.store.quota.QuotaLimitingStore.get(QuotaLimitingStore.java:112)

        at voldemort.store.quota.QuotaLimitingStore.get(QuotaLimitingStore.java:35)

        at voldemort.server.protocol.vold.VoldemortNativeRequestHandler.handleGet(VoldemortNativeRequestHandler.java:312)

        at voldemort.server.protocol.vold.VoldemortNativeRequestHandler.handleRequest(VoldemortNativeRequestHandler.java:63)

        at voldemort.server.niosocket.AsyncRequestHandler.read(AsyncRequestHandler.java:132)

        at voldemort.common.nio.SelectorManagerWorker.run(SelectorManagerWorker.java:103)

        at voldemort.common.nio.SelectorManager.run(SelectorManager.java:214)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

2015-03-19 17:35:17,569 voldemort-niosocket-server16 INFO  voldemort.server.niosocket.AsyncRequestHandler - Protocol negotiated for Socket[addr=/10.6.1.21,port=24754,localport=6666]: voldemort-native-v1

[Arunachalam]

You have somehow built a corrupted data.

Thanks,

Arun.

--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.