Skip to content

Instantly share code, notes, and snippets.

@leonj1

leonj1/fuse_write_working.txt

Last active August 3, 2017 12:19
Show Gist options
  • Save leonj1/ad6080602d0138c9cc727031839e1c9d to your computer and use it in GitHub Desktop.
Save leonj1/ad6080602d0138c9cc727031839e1c9d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
fuse_write_working.txt
20:46:56.597867 Dispatch 2: LOOKUP, NodeId: 1. names: [tmp] 4 bytes
** Lookup **
** Lookup: header: &{44 1 2 1 {{0 0} 17904} 0} Name: tmp **
** internalLookup out: {M00 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 0.000000000 C 0.000000000} parent: &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[] map[] 0xc4200b46e0} name: tmp header: &{44 1 2 1 {{0 0} 17904} 0}**
------------------------
In pathfs.Lookup
GetAttr
Fileystem info for tmp: {0 0 10970 16386 supergroup 0 1501706646380 hdfs 1777 0 0 DIRECTORY}
GetAttr FileStatus: {0 0 10970 16386 supergroup 0 1501706646380 hdfs 1777 0 0 DIRECTORY}
GetAttr: Directory found
fuse.Attr is: {M040755 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 1501706646380.000000000 C 0.000000000}
In pathfs.Lookup OK
------------------------
In pathfs.findChild
In pathfs.findChild is creating child
------------------------
In pathfs.createChild
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[] map[] 0xc4200b46e0}
------------------------
pathfs.SetInode
pathfs.SetInode: Setting n.inode to: &{{0 0 0} 0 {0 0} [] 0xc420095ef0 <nil> map[] map[] <nil>}
------------------------
pathfs.OnAdd (no-op)
In pathfs.createChild: Created and returning: &{0xc4200b4690 0xc4200ba4d0 0 0xc42007a8c0}
In pathfs.findChild. Setting client Inode: 0
------------------------
pathfs.setClientInode
pathfs.setClientInode: not setting anything
In pathfs.findChild. Returning: &{0xc4200b4690 0xc4200ba4d0 0 0xc42007a8c0}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 0 0} 0 {0 0} [] 0xc420095ef0 0xc4200b46e0 map[] map[{0xc42007a460 tmp}:{}] <nil>}
In pathfs.Lookup: Out set to {0 0 0 0 1501706646380 0 0 0 0 16877 0 {0 0} 0 0 0}
Returing node: &{{0 0 0} 0 {0 0} [] 0xc420095ef0 0xc4200b46e0 map[] map[{0xc42007a460 tmp}:{}] <nil>} and Code: OK
** internalLookup ** Returning2 Child: &{{0 0 0} 0 {0 0} [] 0xc420095ef0 0xc4200b46e0 map[] map[{0xc42007a460 tmp}:{}] <nil>} Code: OK
20:46:56.627287 Serialize 2: LOOKUP code: OK value: {NodeId: 3 Generation=0 EntryValid=0.000 AttrValid=0.000 Attr={M040755 SZ=0 L=0 0:0 B0*0 i0:3 A 0.000000000 M 1501706646380.000000000 C 0.000000000}}
20:46:56.627367 Dispatch 3: LOOKUP, NodeId: 3. names: [jose] 5 bytes
** Lookup **
** Lookup: header: &{45 1 3 3 {{0 0} 17904} 0} Name: jose **
** internalLookup out: {M00 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 0.000000000 C 0.000000000} parent: &{{0 3 1} 0 {0 0} [] 0xc420095ef0 0xc4200b46e0 map[] map[{0xc42007a460 tmp}:{}] <nil>} name: jose header: &{45 1 3 3 {{0 0} 17904} 0}**
------------------------
In pathfs.Lookup
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 3 1} 0 {0 0} [] 0xc420095ef0 0xc4200b46e0 map[] map[{0xc42007a460 tmp}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
GetAttr
Fileystem info for tmp/jose: {0 0 33 218923433 supergroup 0 1501706220552 dsproxy 755 0 0 DIRECTORY}
GetAttr FileStatus: {0 0 33 218923433 supergroup 0 1501706220552 dsproxy 755 0 0 DIRECTORY}
GetAttr: Directory found
fuse.Attr is: {M040755 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 1501706220552.000000000 C 0.000000000}
In pathfs.Lookup OK
------------------------
In pathfs.findChild
In pathfs.findChild is creating child
------------------------
In pathfs.createChild
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 3 1} 0 {0 0} [] 0xc420095ef0 0xc4200b46e0 map[] map[{0xc42007a460 tmp}:{}] <nil>}
------------------------
pathfs.SetInode
pathfs.SetInode: Setting n.inode to: &{{0 0 0} 0 {0 0} [] 0xc4201524e0 <nil> map[] map[] <nil>}
------------------------
pathfs.OnAdd (no-op)
In pathfs.createChild: Created and returning: &{0xc4200b4690 0xc4200ba4d0 0 0xc4201543f0}
In pathfs.findChild. Setting client Inode: 0
------------------------
pathfs.setClientInode
pathfs.setClientInode: not setting anything
In pathfs.findChild. Returning: &{0xc4200b4690 0xc4200ba4d0 0 0xc4201543f0}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 0 0} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>}
In pathfs.Lookup: Out set to {0 0 0 0 1501706220552 0 0 0 0 16877 0 {0 0} 0 0 0}
Returing node: &{{0 0 0} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>} and Code: OK
** internalLookup ** Returning2 Child: &{{0 0 0} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>} Code: OK
20:46:56.633763 Serialize 3: LOOKUP code: OK value: {NodeId: 4 Generation=0 EntryValid=0.000 AttrValid=0.000 Attr={M040755 SZ=0 L=0 0:0 B0*0 i0:4 A 0.000000000 M 1501706220552.000000000 C 0.000000000}}
20:46:56.633811 Dispatch 4: LOOKUP, NodeId: 4. names: [99a.txt] 8 bytes
** Lookup **
** Lookup: header: &{48 1 4 4 {{0 0} 17904} 0} Name: 99a.txt **
** internalLookup out: {M00 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 0.000000000 C 0.000000000} parent: &{{0 4 1} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>} name: 99a.txt header: &{48 1 4 4 {{0 0} 17904} 0}**
------------------------
In pathfs.Lookup
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 4 1} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
GetAttr
Fileystem info for tmp/jose/99a.txt: {0 0 0 0 0 0 0 0 }
GetAttr FileStatus: {0 0 0 0 0 0 0 0 }
Does not exist: tmp/jose/99a.txt
In pathfs.Lookup NOTOK
Returing node: <nil> and Code: 2=no such file or directory
** internalLookup ** Returning2 Child: <nil> Code: 2=no such file or directory
20:46:56.640280 Serialize 4: LOOKUP code: 2=no such file or directory value: {NodeId: 0 Generation=0 EntryValid=0.000 AttrValid=0.000 Attr={M00 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 0.000000000 C 0.000000000}}
20:46:56.640342 Dispatch 5: CREATE, NodeId: 4. data: {0105340 [WRONLY,CREAT,0x8000] (022)} names: [99a.txt] 8 bytes
** Create **
------------------------
In pathfs.Create
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 4 1} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
================================
In Create. Name: tmp/jose/99a.txt, Flags: 32833, Mode: 35552. Context: &{{0 0} 17904}
Attempting to Create tmp/jose/99a.txt
================================
In WebPutHandleRedirect. Path: http://dnj2-bach-r1n12:50070/webhdfs/v1/tmp/jose/99a.txt?user.name=dsproxy&op=CREATE
Created (WebPutHandleRedirect)
In Create: Opening file
.......................
default.Open
In Create: Bad things happened. File:<nil>, Code: 38=function not implemented. Exiting
Create, return code 38=function not implemented
In pathfs.Create NOTOK
20:46:56.671057 Serialize 5: CREATE code: 38=function not implemented value: {NodeId: 0 Generation=0 {M00 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 0.000000000 C 0.000000000} &{0 0 0}}
20:46:56.671165 Dispatch 6: MKNOD, NodeId: 4. data: {0105340 (022), 0} names: [99a.txt] 8 bytes
** Mknod **
------------------------
In pathfs.Mknod
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 4 1} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
================================
In Mknod: Name: tmp/jose/99a.txt, Mode: 35552, Dev:0, Context: &{{0 0} 17904}
Mknod, returning OK
In pathfs.Mknod OK
------------------------
In pathfs.createChild
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 4 1} 0 {0 0} [] 0xc4201524e0 0xc4200b46e0 map[] map[{0xc42007a8c0 jose}:{}] <nil>}
------------------------
pathfs.SetInode
pathfs.SetInode: Setting n.inode to: &{{0 0 0} 0 {0 0} [] 0xc4201908d0 <nil> map[] map[] <nil>}
------------------------
pathfs.OnAdd (no-op)
In pathfs.createChild: Created and returning: &{0xc4200b4690 0xc4200ba4d0 0 0xc42007b0a0}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 0 0} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
Exiting pathfs.Mknod. Child: &{{0 0 0} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}, Code: OK
------------------------
In pathfs.GetAttr
Out: {M00 SZ=0 L=0 0:0 B0*0 i0:0 A 0.000000000 M 0.000000000 C 0.000000000}
File: <nil>
Context: &{{0 0} 17904}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 0 0} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
In pathfs.GetAttr: file == nil || code == fuse.ENOSYS || code == fuse.EBADF
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 0 0} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
GetAttr
Fileystem info for tmp/jose/99a.txt: {1501706816658 134217728 0 290783880 supergroup 0 1501706816663 dsproxy 755 3 0 FILE}
GetAttr FileStatus: {1501706816658 134217728 0 290783880 supergroup 0 1501706816663 dsproxy 755 3 0 FILE}
GetAttr: File found
fuse.Attr is: {M0100644 SZ=0 L=0 0:0 B0*0 i0:0 A 1501706816658.000000000 M 1501706816663.000000000 C 0.000000000}
In pathfs.GetAttr: setting client inode (DISABLED)
------------------------
pathfs.setClientInode
pathfs.setClientInode: not setting anything
In pathfs.GetAttr: isDir
In pathfs.GetAttr. Returning code OK
------------------------
In pathfs.GetAttr
Out: {M0100644 SZ=0 L=1 0:0 B0*0 i0:5 A 1501706816658.000000000 M 1501706816663.000000000 C 0.000000000}
File: <nil>
Context: &{{0 0} 17904}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 5 1} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
In pathfs.GetAttr: file == nil || code == fuse.ENOSYS || code == fuse.EBADF
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 5 1} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
GetAttr
Fileystem info for tmp/jose/99a.txt: {1501706816658 134217728 0 290783880 supergroup 0 1501706816663 dsproxy 755 3 0 FILE}
GetAttr FileStatus: {1501706816658 134217728 0 290783880 supergroup 0 1501706816663 dsproxy 755 3 0 FILE}
GetAttr: File found
fuse.Attr is: {M0100644 SZ=0 L=0 0:0 B0*0 i0:0 A 1501706816658.000000000 M 1501706816663.000000000 C 0.000000000}
In pathfs.GetAttr: setting client inode (DISABLED)
------------------------
pathfs.setClientInode
pathfs.setClientInode: not setting anything
In pathfs.GetAttr: isDir
In pathfs.GetAttr. Returning code OK
20:46:56.683736 Serialize 6: MKNOD code: OK value:
20:46:56.683827 Dispatch 7: OPEN, NodeId: 5. data: {WRONLY,0x8000}
** Open **
------------------------
In pathfs.Open
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 5 1} 0 {0 0} [] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
In Open
Attempting to open
Returning contents:
Setting webHdfFile to have webHdfs path as http://dnj2-bach-r1n12:50070/webhdfs/v1/tmp/jose/99a.txt?user.name=dsproxy
In file.SetInode
20:46:56.713662 Serialize 7: OPEN code: OK value: {Fh 2 }
20:46:57.724724 Dispatch 8: GETXATTR, NodeId: 5. data: {sz 0} names: [security.capability] 20 bytes
** GetXAttrSize **
------------------------
pathfs.GetXAttr
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 5 1} 0 {0 0} [0xc4200b5130] 0xc4201908d0 0xc4200b46e0 map[] map[{0xc4201543f0 99a.txt}:{}] <nil>}
------------------------
pathfs.Inode
pathfs.Inode: Returning &{{0 2 1} 0 {0 0} [] 0xc420095140 0xc4200b46e0 map[tmp:0xc42007a8c0] map[] 0xc4200b46e0}
GetXAttr
Input. name: tmp/jose/99a.txt, attribute: security.capability. context: &{{0 0} 17904}
20:46:57.724815 Serialize 8: GETXATTR code: OK value:
20:46:57.724885 Dispatch 9: WRITE, NodeId: 5. 4 bytes
** Write **
------------------------
In pathfs.Write. File: webHdfsFile, Offset: 0
In pathfs.Write calling file.Write
================================
In Write. webHdfsFile
--------------------------------
In WebWriteHandleRedirect. Path: http://dnj2-bach-r1n12:50070/webhdfs/v1/tmp/jose/99a.txt?user.name=dsproxy
Writing to WebHdfs path: http://dnj2-bach-r1n12:50070/webhdfs/v1/tmp/jose/99a.txt?user.name=dsproxy&overwrite=true&op=CREATE
Writing to location path: http://dev.example.com:1006/webhdfs/v1/tmp/jose/99a.txt?op=CREATE&delegation=secretToken&namenoderpcaddress=CLUSTER&createflag=&createparent=true&overwrite=true
Created (by WebWriteHandleRedirect)
20:46:57.879768 Serialize 9: WRITE code: OK value:
20:46:57.879848 Dispatch 10: FLUSH, NodeId: 5. data: {Fh 2}
** Flush **
In file.Flush
20:46:57.879870 Serialize 10: FLUSH code: OK value:
20:46:57.879917 Dispatch 11: RELEASE, NodeId: 5. data: {Fh 2 WRONLY,0x8000 L0}
** Release **
...............................
In fsops.Release: unregisterFileHandle
...............................
In fsmount.unregisterFileHandle
In fsmount.unregisterFileHandle. Open files before: [File webHdfsFile () WRONLY,0x8000 ]
In fsmount.unregisterFileHandle: 0
In fsmount.unregisterFileHandle. Open files after: []
In fsmount.unregisterFileHandle. Done
In fsops.Release: Release()
In file.Release
20:46:57.879981 Serialize 11: RELEASE code: OK value:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment