alluxio ufs with swift

krish

unread,

Mar 9, 2016, 10:52:13 AM3/9/16

to Alluxio Users

trying to mount swift as ufs and struck here. can you suggest what wrong?

Alluxio version: 1.0.0

> swift list k -p demo

demo/catalog.cat

>alluxio fs mount /demo swift://k/demo

ThriftIOException(message:Ufs path /demo does not exist)

> user.log

2016-03-09 10:40:44,031 ERROR logger.type (AlluxioShell.java:run) - Error runnin g mount /demo swift://k/demo

java.io.IOException: ThriftIOException(message:Ufs path /demo does not exist)

at alluxio.AbstractClient.retryRPC(AbstractClient.java:326)

at alluxio.client.file.FileSystemMasterClient.mount(FileSystemMasterClie nt.java:311)

at alluxio.client.file.BaseFileSystem.mount(BaseFileSystem.java:224)

at alluxio.client.file.BaseFileSystem.mount(BaseFileSystem.java:215)

at alluxio.shell.command.MountCommand.run(MountCommand.java:55)

at alluxio.shell.AlluxioShell.run(AlluxioShell.java:182)

at alluxio.shell.AlluxioShell.main(AlluxioShell.java:66)

Caused by: ThriftIOException(message:Ufs path /demo does not exist)

at alluxio.thrift.FileSystemMasterClientService$mount_result$mount_resul tStandardScheme.read(FileSystemMasterClientService.java:13195)

at alluxio.thrift.FileSystemMasterClientService$mount_result$mount_resul tStandardScheme.read(FileSystemMasterClientService.java:13172)

at alluxio.thrift.FileSystemMasterClientService$mount_result.read(FileSy stemMasterClientService.java:13114)

at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86)

at alluxio.thrift.FileSystemMasterClientService$Client.recv_mount(FileSy stemMasterClientService.java:547)

at alluxio.thrift.FileSystemMasterClientService$Client.mount(FileSystemM asterClientService.java:533)

at alluxio.client.file.FileSystemMasterClient$13.call(FileSystemMasterCl ient.java:314)

at alluxio.client.file.FileSystemMasterClient$13.call(FileSystemMasterCl ient.java:311)

at alluxio.AbstractClient.retryRPC(AbstractClient.java:322

>swift object server throwing error with 404 & looking path "//demo" instead "/demo"

"swift object server HEAD /sdd/337/AUTH_53d214c2812d4e47b4a354205cab917b/k//demo

Mar 9 10:41:36 r09r08u15 swift: allow user with role(s) swiftoperator as account admin (txn: tx2bd3e1e95cf146c385e39-0056e04430) (client_ip: 10.30.22.169)

Mar 9 10:41:36 r09r08u15 object-server: 10.30.22.172 - - [09/Mar/2016:15:41:36 +0000] "HEAD /sdd/794/AUTH_53d214c2812d4e47b4a354205cab917b/k//demo" 404 - "HEAD http://10.30.22.172:8080/v1/AUTH_53d214c2812d4e47b4a354205cab917b/k//demo" "tx2bd3e1e95cf146c385e39-0056e04430" "proxy-server 16562" 0.0007 "-" 16432 0

Mar 9 10:41:36 r09r08u15 swift: 10.30.22.169 10.30.22.169 09/Mar/2016/15/41/36 HEAD /v1/AUTH_53d214c2812d4e47b4a354205cab917b/k//demo HTTP/1.0 404 - Apache-HttpClient/4.4%20%28Java%201.5%20minimum%3B%20Java/1.7.0_79%29 97546838078b4046... - - - tx2bd3e1e95cf146c385e39-0056e04430 - 0.0180 - - 1457538096.44

krish

unread,

Mar 9, 2016, 11:53:40 AM3/9/16

to Alluxio Users

and when i persist

alluxio fs persist /demo/opt1

in swift side logs shows

PUT /v1/AUTH_53d214c2812d4e47b4a354205cab917b/t1/

swift: 10.30.22.169 10.30.22.169 09/Mar/2016/16/50/14 PUT /v1/AUTH_53d214c2812d4e47b4a354205cab917b/t1/spark-1.6.0-bin................

Gene Pang

unread,

Mar 11, 2016, 11:34:04 AM3/11/16

to Alluxio Users

Hi,

Unfortunately, I do not have direct experience running Swift, but I just want to ask if you have already tried the everything described here: http://www.alluxio.org/documentation/v1.0.0/en/Configuring-Alluxio-with-Swift.html

Thanks,

Gene

Haoyuan Li

unread,

Mar 19, 2016, 3:55:17 PM3/19/16

to Alluxio Users

krish,

was the issue addressed?

Best,

Haoyuan

Reply all

Reply to author

Forward