Why Gemfury? Push, build, and install  RubyGems npm packages Python packages Maven artifacts PHP packages Go Modules Debian packages RPM packages NuGet packages

Repository URL to install this package:

Details    
python3-s3fuse-plugin-el9 / usr / lib / python3.9 / site-packages / s3fuse / __pycache__ / s3vaultfuse.cpython-39.opt-1.pyc
Size: Mime:
a

èƜeüFã'@sØdZddlZddlZddlZddlZddlZddlZddlmZddlZddl	Z	ddl
Z
ddlZddlZddlm
Z
ddlmZzddlmZmZWn"ey¶ddlmZmZYn0ddlmZzddlmZmZmZWn(eyddlmZmZmZYn0dd	lmZdd
lmZzddl m!Z!Wn eyNddl"m!Z!Yn0ddl#m$Z%dd
l&m'Z'ddl#m(Z(ddl#m)Z)dZ*dZ+dZ,dZ-e!j.ddddde!j.dddddgZ/e!j0dddde!j0d dd!de!j0d"dd#de!j0d$dd%d&d'e!j0d(e*d)d*d'e!j0d+dd,d-d.e!j0d/d0d1d2e!j.d3dd4d5e!j0d6d7d8d5g	Z1e!j.d9d:d;d5e!j.d<dd=d5e!j.d>dd?d5e!j.d@ddAd5e!j2dBdCdDd5gZ3e!j2dEdFdGd5e!j2dHdIdJd5e!j0dKdLdMd5e!j0dNdOdPd5e!j0dQdRdSd5e!j0dTdUdVd5e!j0dWdXdYd5e!j0dZd[d\d5e!j4d]gd^¢d_d5e!j.d`ddad5e!j.dbddcd5e!j0dddedfd5e!j0dgdedhd5e!j2diddjd5gZ5e!j0dkdldmd5e!j0dndodpe!j0dqdrdod5e!j2dse,dtd5e!j2due-dvd5e!j2dwdxdyd5e!j2dzd{d|d5e!j2d}dd~d5e!j0dd€ddd'e!j0d‚dƒd„d5e!j0d…d†d‡d5e!j0dˆd†d‰d5e!j0dŠd†d‹d5e!j0dŒd†dd5e!j0dŽd†dd5e!j0dd‘d’d5e!j.d“d:d”d5e!j0d•e'ƒd–d5e!j0d—d˜d™d5e!j0dšd›dœd5e!j0ddždŸd5e!j0d džd¡d5e!j0d¢d£d¤d5e!j0d¥d¦d§d5e!j0d¨d©dªd5e!j0d«d¬d­d5e!j.d®dd¯d5e!j.d°dd±d5gZ6e!j7Z7e7 8e6¡e7 9e1¡e7 9e3¡e7 9e5¡e7 9e/¡ze:ej;d²ƒZ<e7e<gƒWn&eyZe7ej=dCd…ƒYn0d³e7 >¡vsxd³e) ?¡vr†dd´l@mAZAnddµl#mBZAe% Ce7¡ZDddCgd¶dddddddddddddd·œ
d:dd†d†ej; Ed¸¡ej; Ed¹¡ej; Edº¡d†d†dd:ddd†d†d†ddddgddd:ddd:d»d»d»d»ddd¼œ&ZFd½d¾„ZGd»ZHd¿ZIe J¡ZKe Le M¡¡jNZOdÀZPdÁZQdÂdÄZRdÄdńZSdÆdDŽZTGdÈdɄdÉeUƒZVGdÊd˄dËeVƒZWGdÌd̈́dÍeUƒZXGdÎdτdÏeƒZYdØdÑd҄ZZdÓdԄZ[dÕdքZ\e]d×krÔe\ƒdS)Ùad Trilio Fuse plugin implimentation

    This module is based on the vaultfuse.py module and will eventually
    become the new vaultfuse.py module once integration and refactoring
    of the existing vaultswift.py is complete.

    Currently this module is temporary for the 2.6 release and will be merged
    into a new vaultfuse.py for the next release.
éN)Údatetime)ÚThread)Úgetpwnam)ÚQueueÚEmpty)ÚLRUCache)ÚFUSEÚFuseOSErrorÚ
Operations)ÚClientError)Úbunchify)Úcfg)Ú
tr_logging)Úget_ssl_cert_path)Úvaults3)Ú
config_parserz%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2édéÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarrzlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated.  Please use logging_context_format_string and logging_default_format_string instead.)rrrzlog-date-formatZDATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)rÚdeprecated_namerzlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)rrz
use-syslogzUse syslog for logging.)rrzsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTzLog output to standard errorZuse_journalz%Enable Systemd native journal supportZuse_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_burstézBurst limitZlog_rotate_intervaléz0Interval, number of hours, of log rate limiting.Zmax_logfile_counté<zNumber of log files to retain.Zlog_rotate_interval_typeZHourszUnits of log rotation intervalZlog_rotation_typeÚintervalztype of log retentionZlogging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZlogging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levels)zamqplib=WARNzsqlalchemy=WARNz	boto=WARNz	suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Zvault_storage_typeZs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)rÚvault_data_directory_oldz/var/triliovaultÚqueue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_countéz(The number of times we retry on failuresÚvault_segment_sizeizvault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileZvault_s3_auth_versionZDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚz	S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez	S3 RegionÚvault_s3_bucketz	S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚvault_s3_sslÚFalsezEnable SSL certificateÚvault_s3_ssl_verifyz)Whether or not to verify SSL certificatesÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionrzS3 signature version to useÚvault_s3_read_timeoutZ30z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolÚTruezEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Zvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).Úvault_s3_max_pool_connectionsÚ500z>The maximum number of connections to keep in a connection poolÚbucket_object_lockz#S3 bucket object locking is enabledÚuse_manifest_suffixzyTo preserve backward compatibility, set this to False.When set to False, s3fuse creates manifest file nameswithout suffixZFLAGZs3fuse_sys_admin)Úfs)Úutilsú1.0)
Zproject_nameÚregion_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ	tenant_idZservice_typeZ
project_idZ
auth_tokenZproject_domain_nameZ	OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_torÚheaderÚauth_versionÚ
os_optionsZssl_compressionZos_storage_urlZos_usernameZos_passwordZ	os_cacertZos_certZos_keyZos_tenant_nameZos_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclÚinfoZretriesZ	write_aclÚmetarZuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚobject_namecCs
dtd<tjtd<tjtd<tjtd<tjtd<tjtd<tjtd<tjtd	<tj	td
<tj
td<dtd
<tjtd<dtd<tjrtjtdd<tj
r¤tj
tdd<tjs¶tjtd<nPtj
 ¡dkrÞtj tj¡rÞtjtd
<n(tj
 ¡dkrt dtj¡dtd
<dS)Nr=rCrErFZbucketZs3_signatureZs3_read_timeoutr7r9r:Zs3_sslr)Zs3_ssl_certZ
s3_ssl_verifyZ
GOVERNANCEZretention_moderDr?r>ÚtrueZfalsezcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connection)ÚoptionsÚCONFr(r*r,r2r3r7r9r:r.r0r-r+ÚlowerÚosÚpathÚexistsr1ÚLOGÚwarn©rTrTú6/usr/lib/python3.9/site-packages/s3fuse/s3vaultfuse.pyÚ
option_config…s@




ÿ



ÿ
ÿýÿrVéz
%016x.%08xiècst ˆ¡‡fdd„ƒ}|S)Ncsòztj tj¡Wn"ty4tj tjj¡Yn0z~ˆ|i|¤ŽWztj tj¡WStyztj tjj¡YS0Sztj tj¡Wqîty²tj tjj¡Yqî0n8ztj tj¡Wn"tyêtj tjj¡Yn00dS©N)ÚloggingÚdisableZERRORÚ
BaseExceptionZNOTSET)ÚargsÚkwargs©ÚfuncrTrUÚwrapperµs&ûýz disable_logging.<locals>.wrapper)Ú	functoolsÚwraps)r_r`rTr^rUÚdisable_logging´srccCsRtj |¡\}}d}|dvrJ|dkr4tj ||¡}n|}tj |¡\}}q||fS©Nr))r)ú/©rOrPÚsplitÚjoin)rPÚheadÚtailÚprefixrTrTrUÚsplit_head_tailÅsrlcCstj |¡\}}|SrX©rOrPrg)rPrirjrTrTrUÚget_headÒsrnc@s€eZdZdd„Zdd„Zdd„Zdd„Zd	d
„Zdd„Zd
d„Z	dd„Z
ddd„Zddd„Zdd„Z
dd„Zdd„Zdd„ZdS) ÚObjectRepositorycKs
||_dSrX)Úroot©Úselfrpr]rTrTrUÚ__init__ØszObjectRepository.__init__cCs.| d¡r|dd…}tj t|¡}| |¡S©Nrer)Ú
startswithrOrPrhÚ_SEGMENT_PREFIXÚ
_full_path©rrÚpartialrPrTrTrUÚ_full_segment_pathÜs
z#ObjectRepository._full_segment_pathcCs*| d¡r|dd…}tj |j|¡}|Srt©rurOrPrhrprxrTrTrUrwãs
zObjectRepository._full_pathcCsdSrXrT)rrrJÚflagsrTrTrUÚobject_openészObjectRepository.object_opencCsdSrXrT)rrrJÚoffÚbufÚfhrTrTrUÚ
object_uploadìszObjectRepository.object_uploadcCsdSrXrT)rrrJÚoffsetr€rTrTrUÚobject_downloadïsz ObjectRepository.object_downloadcCsdSrXrT)rrrJrTrTrUÚ
object_deleteòszObjectRepository.object_deletecCsdSrXrT©rrrJr€rTrTrUÚobject_closeõszObjectRepository.object_closeNcCsdSrXrT©rrrJÚlengthr€rTrTrUÚobject_truncateøsz ObjectRepository.object_truncatecCsdSrXrTr…rTrTrUÚobject_getattrûszObjectRepository.object_getattrcCsdSrXrT©rrrPr€rTrTrUÚobject_readdirþszObjectRepository.object_readdircCsdSrXrT©rrrPÚmoderTrTrUÚ
object_accessszObjectRepository.object_accesscCsdSrXrT©rrrPrTrTrUÚ
object_unlinkszObjectRepository.object_unlinkcCsdSrXrTrrTrTrUÚ
object_statfsszObjectRepository.object_statfs)N)N)Ú__name__Ú
__module__Ú__qualname__rsrzrwr}rrƒr„r†r‰rŠrŒrr‘r’rTrTrTrUro×s

rocsˆeZdZ‡fdd„ZGdd„deƒZGdd„dƒZdd„Zd	d
„Zdd„Z	d
d„Z
dd„Zifdd„Zdd„Z
dd„Zdd„Zdd„Zdd„Zdd„Zdd „Zd!d"„Zd#d$„Zd%d&„ZdYd(d)„Zd*d+„Zd,d-„Zd.d/„Zd0d1„ZdZd2d3„Zd4d5„Zd6d7„Zd8d9„Zd:d;„Z d<d=„Z!d>d?„Z"d@dA„Z#d[dCdD„Z$dEdF„Z%d\dGdH„Z&dIdJ„Z'dKdL„Z(dMdN„Z)dOdP„Z*dQdR„Z+dSdT„Z,d]dUdV„Z-dWdX„Z.‡Z/S)^ÚBackendRepositorycsvtt|ƒj|fi|¤Žttƒj|_ttƒj|_i|_	t
 t¡|_
i|_t ¡|_i|_i|_i|_| dt¡|_dS)Nr)Úsuperr–rsrÚ	FUSE_USERÚpw_uidr@Úpw_gidÚgroup_idÚmanifestrÚ	S3BackendrLÚ_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ	threadingÚLockÚ#_BackendRepository__open_close_lockÚ_BackendRepository__in_openÚ_BackendRepository__worker_poolÚ_BackendRepository__pending_iosÚBackendWorkerPoolÚ,_BackendRepository__object_open_backend_poolrq©Ú	__class__rTrUrss
zBackendRepository.__init__c@s0eZdZdZdd„Zdd„Zdd„Zdd	„Zd
S)zBackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
        cCs8t |¡t |¡|_||_t ¡|_d|_	| 
¡dS)NT)rrsrrÚ_BackendWorker__backendÚ_BackendWorker__job_queuer ÚEventÚ_stop_eventÚdaemonÚstart)rrÚ	job_queuerLrTrTrUrs.s

z(BackendRepository.BackendWorker.__init__cCs|j ¡dSrX)r­Úset©rrrTrTrUÚstop8sz$BackendRepository.BackendWorker.stopcCs
|j ¡SrX)r­Úis_setr²rTrTrUÚstopped;sz'BackendRepository.BackendWorker.stoppedc
Cs²t dt ¡j¡| ¡s®zL|j dd¡\}}}z&||jg|¢Ri|¤ŽW|j 	¡n|j 	¡0Wqt
y~YqYqtyª}zt |¡WYd}~qd}~00qdS)zO Start up the worker and block until there is an item in the queue
            zStarting worker thread[%x].TrN)
rRrGr Úcurrent_threadÚidentrµr«ÚgetrªZ	task_donerÚ	ExceptionÚ	exception)rrr_r\ÚkargsÚerTrTrUÚrun>sÿÿz#BackendRepository.BackendWorker.runN)r“r”r•Ú__doc__rsr³rµr½rTrTrTrUÚ
BackendWorker*s

r¿c@s8eZdZdZdd„Zdd„Zdd„Zdd	„Zd
d„ZdS)
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
        cCs:ttjƒ|_g|_t|ƒD]}|j t |j|¡¡qdSrX)	rrMr#r°ÚworkersÚrangeÚappendr–r¿)rrZnum_threadsrLÚ_rTrTrUrsWsÿz,BackendRepository.BackendWorkerPool.__init__cCs,|jD]}| ¡q|jD]}| ¡qdSrX)rÀr³rh)rrÚtrTrTrUÚ__del___s


z+BackendRepository.BackendWorkerPool.__del__cOs|j |||f¡dS)z+ Add a job to the worker queue
            N)r°Zput)rrr_r\r»rTrTrUÚadd_jobfsz+BackendRepository.BackendWorkerPool.add_jobcCs|D]}| ||¡qdS)z4 Add a list of jobs to the worker queue
            N)rÆ)rrr_Z	args_listr\rTrTrUÚmapksz'BackendRepository.BackendWorkerPool.mapcCs|j ¡dS)z> Wait for completion of all the jobs in the queue
            N)r°rhr²rTrTrUÚwait_completionqsz3BackendRepository.BackendWorkerPool.wait_completionN)	r“r”r•r¾rsrÅrÆrÇrÈrTrTrTrUr¦Ssr¦cCsRtj |¡\}}d}|dvrJ|dkr4tj ||¡}n|}tj |¡\}}q||fSrdrf)rrrPrirjrkrTrTrUrlvsz!BackendRepository.split_head_tailcCstj |¡\}}|SrXrm)rrrPrirjrTrTrUÚ	_get_head‚szBackendRepository._get_headcCs.| d¡r|dd…}tj t|¡}| |¡Srt)rurOrPrhrvÚ
_get_cacherxrTrTrUÚ_get_segment_cache†s
z$BackendRepository._get_segment_cachecCs*| d¡r|dd…}tj |j|¡}|Srtr{rxrTrTrUrʌs
zBackendRepository._get_cachecCs6| |¡\}}t ¡}||d<t|ƒ}|j |¡}|S)NrJ)rlrLÚcopyrržZget_object_manifest)rrrJÚ	containerrkÚ_optsrœrTrTrUÚ_read_object_manifest’sz'BackendRepository._read_object_manifestc
Csd| |¡\}}i}d|d<t ¡}||d<| ¡D]\}}	|	|d|<q2t|ƒ}|j |||¡dS)NrKzx-static-large-objectrJúx-object-meta-)rlrLrÌÚitemsrržZupload_object_manifest)
rrrJÚobject_manifestÚmetadatarÍrkZput_headersrÎrFÚvaluerTrTrUÚ_write_object_manifestšsÿz(BackendRepository._write_object_manifestcCsBt d|¡t ¡}t|ƒ}t| d¡dg}|j ||¡dS)Nú	mkdir, %sreú	-segments)	rRrrLrÌrrvÚlstripržÚmkdir_object)rrrJrÎr\rTrTrUÚ_create_segments_folder«s
z)BackendRepository._create_segments_folderc
CsÎ| |¡\}}t ¡}|dkr$g}n|g}d|d<d|d<d|d<d|d<d|d<t|ƒ}|dkrv||d<| |¡nd}|j ||¡}i}|dd	 ¡D],\}}	d
|vrÀ|	|| d
¡d<qœ|	||<qœ|S)Nr)Ú	delimiterFÚhumanÚtotalsÚlongrkÚheadersZMetadatarÐr)	rlrLrÌrrÂržÚstat_objectrÑrg)
rrrJrÍrkrÎr\ÚstrÓrFrÔrTrTrUÚ_get_object_metadata³s,
z&BackendRepository._get_object_metadatacCs| |¡\}}| |¡}|tddƒ@tjk}|jB|j |t 	¡¡|j
 |d¡|j
|d7<Wdƒn1sz0Y|j|\|j |i¡|j |i¡||j
vr|tddƒ@tjksð|tj@tjksð|tj@tjkrLz| |¡}Wn6ty4t d|¡t d¡| |¡}Yn0dii|j
|<|D]V}|d d	¡d}	|	 d
¡d}	t|	dƒ}
| dd¡|d<d
|d<||j
||
<qH| |¡}|j
| |¡z&| |j
|d¡}tj|ddWntyôYn0tjtj |¡ddt|dƒ }
|
 t  !|¡¡Wdƒn1s>0YnÐtjtj |¡dd|tj"@tj"krÞz| #|¡Wnty–Yn0z0t|dƒ}
Wdƒn1s¼0YWntyÜYn0z | $|d¡}tj|ddWntyYn0t ||¡}z€| %|¡|j&|j||<dii|j
|<dd
i|j
|d|<| '||¡W|j| (|d¡|j
|d (|d¡t )|¡n4|j| (|d¡|j
|d (|d¡t )|¡0z0t|dƒ}
Wdƒn1sú0YWntyYn0zddl*m+}||ƒ ,¡WntyLYn0t ||¡}zDzŽd|i|j
|d|<| -t.j/t0¡|j||<t1ƒ|j||<|WW|j"|j
|d8<Wdƒn1sÔ0YWdƒStyb}z\t 2|¡|j| (|d¡|j
|d (|d¡|j| (|d¡t )|¡‚WYd}~n
d}~00W|j"|j
|d8<Wdƒn1s–0Yn<|j"|j
|d8<Wdƒn1sÒ0Y0Wdƒn1sô0YdS)NZfférrz+Manifest for %s not found. Trying in 5 secsrÚopen_handlesÚnameú
-segments/Ú.Ú	versionIdr)FÚmodifiedúsegments-dirT)Úexist_okÚwr×Úreadonly)ÚPath)3rlrwÚintrOÚO_RDONLYr¢rŸÚ
setdefaultr ÚRLockr£r¤r¥rœÚO_RDWRÚO_APPENDrÏr¹rRrGÚtimeÚsleeprgr¸râÚupdateÚmakedirsr[rPÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_WRONLYr‘rzrÚr§Ú
_object_closeÚpopÚcloseÚpathlibrîÚtouchr¦rMr$rLr±rº)rrrJr|rÍrkÚ	full_pathrírœÚsegZoffstrr‚rÓZsegment_dirÚfr€rîÚexrTrTrUr}ïs
ÿÿ0ÿþýÿÿÿ

ÿ4ÿ$ÿ
ÿÿÿÿÿÿýÿÿ$ÿÿÿÿ	2ö

4ÿzBackendRepository.object_openc
CsTz t ¡}t|ƒ}| ||¡Wn.tyN}zt |¡WYd}~n
d}~00dS)zý Utility method to be dispatched to a worker
            thread in order to clean up old segments.

        Args:
            backend (class instance): Instance of the backend plugin.
            segment_list (list): List of segments to remove.
        N)rLrÌrÚdelete_object_listr¹rRrº)rrÚbackendÚsegment_listrÎrrTrTrUZ__purge_old_segments_taskƒsz+BackendRepository.__purge_old_segments_taskcCsî|j|| ¡|j|ºzv|j| ddt|d¡}| |¡\}}g}d}|j|d|dsˆd}d}	d}
||j|vrސqºz| |j||d|¡}Wn6tyât	 
d¡| |j||d|¡}Yn0|j||d	r:t|ƒ}t|j
tjƒ}
| |j||d|j|j|
|jd
œ¡nd|j||d}
| |j||d|j|| dd
¡|j||d|
|j||dd
œ¡|tj7}|d7}|	|
7}	q||j|||t|ƒt|	ƒdœdd}|rˆ| |||¡}
t|
ƒdkrqˆt|
ƒ}
z|j||d}Wnd
}Yn0| d¡}tt|
ƒt|gƒƒ}t|ƒdkrz|j|| |j|¡|tj7}qÞWWdƒdStyÈ}zt  |¡WYd}~n
d}~00Wdƒn1sà0YdS)zé Handle object_close by updating the manifest.

         Waits for all of the background jobs to complete prior to updating
         manifest using the main thread. Also queues up tasks to clean up
         any old segments.
        rêrer×rrärírårré)rPrèÚetagÚ
size_bytesÚcontent_typerrèr)Úhashr
r©rêú
segment-countú
total-size©rÓTN)!r¤rÈrŸrœr¸rvrlrŠr[rõrörÚminÚst_sizerMr&rÂÚ
version_idrr
rÕÚstrr
ÚlenÚsortedÚstripÚlistr±rÆÚ+_BackendRepository__purge_old_segments_taskr¹rRrº)rrrJr€Úsegments_dirrÍrkrÒÚsegmentsr‚Z
total_sizeÚsegment_sizeráÚstatZobjectsÚpZ
purge_listrrTrTrUrÿ’sÎ
þÿÿÿþ
þ
ÿÿùÿÿÿÿÿÿÿþöÿ

ýý


þzBackendRepository._object_closec	CsH| ||¡|j||j| |¡|j| |¡|j|d |¡zt |¡WntynYn0t	|j|dƒdkrÖz0|j |d¡}|j |d¡}t 
| |¡¡WntyÈYn0|j |¡|j6|j
|s||jvr|j |d¡Wdƒn1s0YWdƒn1s:0YdS)Nrär)rÿrŸr¤rr¥rœrOrr[rÚremoverwr¢r£)rrrJr€ZohZpiosrTrTrUr†s*zBackendRepository.object_closec

Cszz,|j|š||j|vrH|j||ddurH|j||d}n8| ||¡}|j| ddt|d¡}tj ||¡}t 	¡}d|j|v|d<Wdƒn1s®0Y| 
|¡\}	}
t|ƒ|d	<|
 d¡|d
<t
|ƒ}|	||d	g}|j|| |¡|j|| |j||||||¡WnFtyt}z,t |¡|j|| |¡‚WYd}~n
d}~00dS)NréTrårêrer×Ú0Ú
path_validrrJ)rŸrœÚ,_BackendRepository__next_segname_from_offsetr¸rvrOrPrhrLrÌrlrÚrstriprr¥Úaddr¤rÆÚ&_BackendRepository__object_upload_taskr¹rRrºr!)
rrrJr‚rr€Úseg_fullnameZsegnamerrÎrÍÚobjÚargs1rrTrTrUr"s@ÿþÿ
þ0ý
zBackendRepository.object_uploadcCsŠt d||t ¡jf¡|d}|d}	|dd…}|j|Wdƒn1sV0Yzd|_| |||	|¡}
Wnntyè}zVt 	|¡|j|$|j
|| |¡Wdƒn1sÈ0Y‚WYd}~n
d}~00|j|€||j|vri|j||<||j||d<d|j||d<|
 
dd	¡|j||d
<|j
|| |¡Wdƒn1s|0YdS)zP Method run by a worker in the thread pool to upload an object segment.
        z6Object [%s] segment [%s] upload running in thread[%x].rr%NTråréÚ	VersionIdr)rè)rRrGr r¶r·rŸr#Z
put_objectr¹rºr¥r!rœr¸)rrr	r*rÎrJr‚r(r€rZbuf_lenZresprrTrTrUZ__object_upload_taskIs4ÿÿ
2
ÿz&BackendRepository.__object_upload_taskc
Cszt d¡|j|~||j||vr6Wdƒq||j|vrdtd|tt|ƒtdƒfƒ‚|j||d}Wdƒq¤Wdƒq1s˜0Yq| | 	d¡¡\}}i}|j|| 
dd¡|d<t|ƒ}||g}z|j 
||¡}	t|	ƒWStyD}
z,|
jd	d
dkr.t |
¡‚WYd}
~
n:d}
~
0tyt}zt |¡‚WYd}~n
d}~00dS)Ngš™™™™™¹?zobject %s not found rrårerèr)rÚResponseMetadataÚHTTPStatusCodeé”)rõrörŸr¥rœr¹ÚSEGMENT_FORMATrïrlr%r¸rržZ
get_objectÚ	bytearrayrÚresponserRrº)rrrJr‚r€r(rÍr)rÎr*rr¼rrTrTrUrƒns:
ÿÿ.ÿ


z!BackendRepository.object_downloadcCsÀ|j |t ¡¡|j|| |¡\}}t ¡}t|ƒ}|g}|dkr\|dkr\| |¡z|j	 
||¡Wn.tyœ}zt 
|¡WYd}~n
d}~00Wdƒn1s²0YdS)Nr)re)rŸrñr ròrlrLrÌrrÂržZ
delete_objectr¹rRrº)rrrJrÍr)rÎr*rrTrTrUr„sÿ

zBackendRepository.object_deleteNcCs&|rdS| |tj¡}| ||¡dSrX)r}rOrþr†r‡rTrTrUr‰£sz!BackendRepository.object_truncatec
Cs¨t ¡}d|d<d|d<d|d<d|d<tj |dt|ƒ¡|d<g}|dkrTg}n|g}t|ƒ}z|j ||¡WSt	y¢}zt
 |¡‚WYd}~n
d}~00dS)	NrÛFrÜrÝrÞz%016xrkr))rLrÌrOrPrhrïrržZ
list_segmentsr¹rRrº)rrrÍrr‚rÎr\rrTrTrUr
©s 
zBackendRepository.segment_listc	CsÀ| |¡\}}|j| dd¡}|rT| dt¡r@| |¡\}}| |¡\}}|}n|d}| |||¡}t|ƒdkrŠtt|ƒtdƒfStt|ƒtt	|ƒd 
|¡d 
d¡ddƒdfS)	Nrêrer×réÿÿÿÿrrçrã)rlrœr¸rurvr
rr/rïrrg)	rrrPr‚rÍrkrÚcr ÚfilesrTrTrUZ__next_segname_from_offset¿s"$ÿþz,BackendRepository.__next_segname_from_offsetc
Cs|j|¨| |¡\}}|j |d¡rd||j|vrd|j||d}| d¡dWdƒS|j| dd¡}|rŽ| |¡\}}|}n|d}| |||¡}	Wdƒn1s¸0Yt|	ƒdkrâtt|ƒtdƒfStt|ƒtt	|	ƒd |¡d d¡dd	ƒfS)
Nrårærrêr×rr2rçrã)
rŸrlrœr¸rgr
rr/rïr)
rrrPr‚rÍrkrrr3r r4rTrTrUÚcurr_segname_from_offsetÔs",$þz*BackendRepository.curr_segname_from_offsetc
s†tj |¡r‚zBt |¡‰t‡fdd„dDƒƒ}d|d<t|ddƒ|d<|WSty|}zt |¡WYd}~n
d}~00dSdS)	aë Utility to check the tmpfs cache and return stat() from that.

         This method looks to see if the object (directory) exists in the
         local cache and will perform a stat() locally instead of calling
         all the way to the backend.

        Args:
            object_cache_path (str): Cache path to the object we
                                     need stat infor on.

        Returns:
            Dictionary of stat() information or None if object does not exist.
        c3s|]}|tˆ|ƒfVqdSrX©Úgetattr©Ú.0rF©rárTrUÚ	<genexpr>ÿsÿz0BackendRepository._stat_cache.<locals>.<genexpr>©Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkrÚst_uidéÚ
st_blksizerÚ	st_blocksN)	rOrPÚisdirÚlstatÚdictrïr¹rRrº)rrZobject_cache_pathÚ	stat_infor¼rTr:rUÚ_stat_cacheís
þ
zBackendRepository._stat_cachecsÚ| |¡}| |¡\}}t ¡}|dkr.g}n|g}d|d<d|d<d|d<d|d<d|d<t|ƒ}i}|dkr„||d<| |¡nd}z`|j ||¡‰|j|d<|j	|d	<ˆd
 
dd¡|d<ˆd
 
d
d¡|d<ˆd
 
dd¡|d<tˆdƒ|d<tˆdƒ|d<tˆdƒ|d<d|d<d|d<|durFd|vrFd|d<tˆdƒ|d<|ddkrn|dks¬|ddkr†|dus¬|ddkrž|dks¬ˆddurèd |d<d!|d<d"|d<| |¡}	t
j |	¡sèt
 |	d#¡WnÎtyj}
zf|
jd$d%d&krt |
¡zt
 |¡Wnty<Yn0tj|dd't
 |¡WYd}
~
nXd}
~
0ty¸}z6t |¡t
 |¡‰t‡fd(d)„d*Dƒƒ}WYd}~n
d}~00d+|d,<t|dd+ƒ|d-<|S).Nr)rÛFrÜrÝrÞrkr?rCrßZETagrr+rZContentTyper
Z	timestampr=r>rArrBiír@Zauthorized_keyi€ÚsizerrZ	directoryTéiiýAiér,r-r.©Ú
ignore_errorsc3s|]}|tˆ|ƒfVqdSrXr6r8r:rTrUr;Zsÿz3BackendRepository.object_getattr.<locals>.<genexpr>r<rDrErF)rwrlrLrÌrrÂržràr›r@r¸rïrÊrOrPrQÚmkdirrr1rRrºr!r¹ÚshutilÚrmtreerHrI)rrrJr€rrÍrkrÎr\rZcontainer_pathr¼rrTr:rUrŠsŒ



ÿÿ
þþ
ýý
ü



þz BackendRepository.object_getattrc
Cs
zt |d¡}Wn0ty@}zt |¡‚WYd}~n
d}~00d}||j|vrÆz |j |j||d|¡Wn8ty¬t	 
d¡|j |j||d|¡Yn0||j||d7}qFz|j ||¡Wn,tyt	 
d¡|j ||¡Yn0dS)Nz%Y-%m-%dT%H:%M:%Srrårr)rÚstrptimer¹rRrºrœržZput_object_segment_retentionr[rõröZput_manifest_retention)rrrJÚretainuntilÚdtrr‚rTrTrUÚ_set_object_retentionos,
ÿ
ÿ

z'BackendRepository._set_object_retentionc	
Cs2| |tj¡}zzÊ|j|¬t |j|¡}d}||j|vrj|j||d}| |d¡||7}q4| dd¡|dkr’| || 	d¡¡n| 	d¡||<|j
 ||¡||j||<Wdƒn1sÐ0YWn2ty}zt
 |¡‚WYd}~n
d}~00W| ||¡n| ||¡0dS)NrrrärTÚutf8úutf-8)r}rOrðrŸrÌÚdeepcopyrœrrVÚdecoderžÚupdate_object_attributesr¹rRrºr†)	rrrJrårÔr€Úattrsr‚rLrrTrTrUÚobject_setxattrs.
ÿÿ0
z!BackendRepository.object_setxattrc
Cs| |tj¡}zòz°|j|’t |j|¡}d}||j|vrh|j||d}| |d¡||7}q2| |d¡| dd¡|j 	||¡|j| |d¡Wdƒn1s´0YWn0t
yð}zt |¡‚WYd}~n
d}~00W| 
||¡n| 
||¡0dS)Nrrrä)r}rOrðrŸrÌrYrœrržr[r¹rRrºr†)rrrJrår€r\r‚rLrrTrTrUÚobject_removexattr¦s&
ÿ4
z$BackendRepository.object_removexattrc
CsÈ| |tj¡}z¦zd|j|Ft |j|¡}| d¡| ¡}|WdƒWW| 	||¡S1sh0YWn0t
y¤}zt |¡‚WYd}~n
d}~00W| 	||¡n| 	||¡0dS)Nrä)
r}rOrðrŸrÌrYrœrÚkeysr†r¹rRrº)rrrJr€r\r_rrTrTrUÚobject_listxattr»s
û
z"BackendRepository.object_listxattrc
Cs¶| |tj¡}z”zR|j|4t|j||dƒWdƒWW| ||¡S1sV0YWn0ty’}zt 	|¡‚WYd}~n
d}~00W| ||¡n| ||¡0dS)NrX)
r}rOrðrŸÚbytesrœr†r¹rRrº)rrrJrår€rrTrTrUÚobject_getxattrÊs$û
z!BackendRepository.object_getxattrc	
cs’g}| d¡d}g}zF||j |¡7}|D]}| | d¡d¡q,t|ƒD]
}|VqNWn0tyŒ}zt |¡‚WYd}~n
d}~00dS)Nrer2)	r%ržÚlist_objectsrÂrgrr¹rRrº)	rrrJr€ZlistingZdir_pathÚdirentsZlstÚrrrTrTrUrŒÕs
z BackendRepository.object_readdircCsdSrXrT)rrrJrŽrTrTrUräszBackendRepository.object_accessFc
CsN|td<t ¡}t|ƒ}|sz¸| |¡}| |¡}g}|D]}| |d¡q<|j ||¡| d¡}|durÔ|g}	|j 	|	|¡zt
 | |¡¡Wnt
yªYn0zt
 | |¡¡Wnt
yÒYn0Wn0ty}
zt |
¡WYd}
~
n
d}
~
00z|j |¡Wn0tyH}
zt |
¡WYd}
~
n
d}
~
00dS)NrIrårê)rLrÌrrÏrârÂržrr¸Úrmdir_objectrOÚrmdirrÊr[r!r¹rRrºZdelete_object_manifest)rrrJrIrÎZobj_manifestZobj_metadatar
Úmanrr\rrTrTrUr‘çs>





zBackendRepository.object_unlinkc	
CsÒt ¡}t|ƒ}g}z|j ||¡}Wn8ty^}z t |¡tt	j
ƒ‚WYd}~n
d}~00d|dvr’t|dƒ}t|dƒt|dƒ}nd}t|dƒ}i}||d<||d<||d<d	|d
<d	|d<|S)Nzx-account-meta-quota-bytesrßzx-account-bytes-usedr2rLÚf_blocksÚf_bfreeÚf_bavailrÚf_favailÚf_frsize)rLrÌrržràr¹rRrºr	ÚerrnoÚENOENTrï)	rrrJrÎr*ZstvrrirkrUrTrTrUr’
s,
 ÿzBackendRepository.object_statfsc

Csât d|¡| |¡\}}t ¡}t|ƒ}||g}z|j ||¡Wn0tyv}zt 	|¡WYd}~dSd}~00| 
|¡}	|durž| 
tj 
||¡¡}	zt |	|¡Wn.tyÜ}zt 	|¡WYd}~n
d}~00dS)NrÖrF)rRrrlrLrÌrržrÙr¹rºrÊrOrPrhrø)
rrrPrŽZistrÍr)rÎr\rÚ
cache_pathrTrTrUrP)s$

 zBackendRepository.mkdirc
Cs| |¡\}}t ¡}d|d<t|ƒ}| d¡d}g}z||jj|dd7}Wn.ty~}zt 	|¡WYd}~n
d}~00t
|ƒdkr–ttj
ƒ‚z|j | d¡g|¡Wn.tyÞ}zt 	|¡WYd}~n
d}~00tj t| d¡¡}z||jj|dd7}Wn0ty<}zt 	|¡WYd}~n
d}~00t
|ƒdkr˜z|j | d¡g|¡Wn0ty–}zt 	|¡WYd}~n
d}~00z&| |¡}	tj |	¡r¼t |	¡WntyÒYn0z&| |¡}
tj |
¡røt |
¡WntyYn0dS)Nrkrer%)Z	max_itemsr)rlrLrÌrr%ržrcr¹rRrºrr	rnZ	ENOTEMPTYrfrOrPrhrvrØrËrGrQrRr[rÊ)rrrJrÍr)rÎrPZ	dir_itemsrZseg_pathZsegment_cache_pathrprTrTrUrgIsR 

 


zBackendRepository.rmdircCsVt d|¡z0| |¡\}}| tj ||¡¡}t ||¡WStyPYn0dS)Nz	chmod, %s)	rRrrlrÊrOrPrhÚchmodr[)rrrPrŽrÍrkrprTrTrUrq€szBackendRepository.chmodcCsXt d|¡z2| |¡\}}| tj ||¡¡}t |||¡WStyRYn0dS)Nz	chown, %s)	rRrrlrÊrOrPrhÚchownr[)rrrPÚuidÚgidrÍrkrprTrTrUrr‰szBackendRepository.chowncCstdƒ‚dS)NzNot Applicable)r¹©rrråÚtargetrTrTrUÚsymlink’szBackendRepository.symlinkc
Csj|j |d¡r2t d¡|j |d¡r2td|ƒ‚t d||f¡|d}z|j|ddWn.tyŒ}zt |¡WYd}~n
d}~00zL| 	|¡}| 	|¡}| d|d¡| d|d¡krØ|j|ddWd	SWntyìYn0d
}z¤z| 	|¡}WntyYn~0| 
|¡}| d|d¡}	g}
|D]4}|
 |d|d|d
| dd¡|ddœ¡q:|j||
|	|d|ddœdd}Wn2t
yÈ}zt |¡‚WYd}~n
d}~00zLzÊ| 
|¡}| 	|¡}| d|d¡}	g}|D]4}| |d|d|d
| dd¡|ddœ¡qü|j|||	|d|ddœdz|j|ddWn0ty”}zt |¡WYd}~n
d}~00Wn2t
yÊ}zt |¡‚WYd}~n
d}~00W|rfz|j|d
dWn0ty}zt |¡WYd}~n
d}~00nL|rdz|j|d
dWn0tyb}zt |¡WYd}~n
d}~000d	S)Néz%s in use. Try againzrename, %s -> %sú~T)rIrêr×rFrårrrèr)r
)rPrrrèr
rrrr)rœr¸rõrör¹rRrr‘rºrârÏrÂrÕr[)
rrÚoldÚnewZnewbak_namerZnew_metadataZold_metadataZnewfile_existsZnew_manifestrZnewbak_manifestrhZold_manifestrTrTrUÚrename•s´

 

ÿ

ÿ
ýÿýÿ



ûÿ
ýý$
"ü"zBackendRepository.renamecCsZt d|¡t|ƒ\}}| tj ||¡¡}t|ƒ\}}| tj ||¡¡}t ||¡S)Nzlink, %s)rRrrlrÊrOrPrhÚlink)rrrvrårÍrkZcache_path_targetZcache_path_namerTrTrUr}szBackendRepository.linkcCsNt d|¡t|ƒ\}}| |¡}zt ||¡WntyHYdS0dS)Nzutimens, %sr)rRrrlrÊrOÚutimer[)rrrPÚtimesrÍrkrprTrTrUÚutimenss
zBackendRepository.utimenscCsdS©NrrTrrTrTrUÚdestroyszBackendRepository.destroy)N)N)F)F)N)0r“r”r•rsrr¿r¦rlrÉrËrÊrÏrÕrÚrâr}rrÿr†rr'rƒr„r‰r
r$r5rKrŠrVr]r^r`rbrŒrr‘r’rPrgrqrrrwr|r}r€r‚Ú
__classcell__rTrTr¨rUr–sZ)#	ÿ
<s'%"
*
X
#
 7		s
r–c@speZdZdd„Zdd„Zddd„Zdd	„Zddd„Zd
d„Zdd„Z	dd„Z
dd„Zdd„Zdd„Z
dd„Zd
S)Ú	FuseCachecCsÚ||_||_i|_t ¡|_ttƒj|_	ttƒj
|_tj
 |j¡sŽz4t |j¡t |jt|j	ƒdt|jƒg¡WqÖtyŠ‚YqÖ0nHt |j¡}|j|j	ks²|j|jkrÖt tjt|j	ƒdt|jƒg¡dS)Nú:)rpÚ
repositoryÚlrucacher r¡Ú
lrucache_lockrr˜r™r@ršr›rOrPrGr;rPrrrr[rrCr?rMr")rrrpr†rJrTrTrUrs7s*
ÿ

ÿÿzFuseCache.__init__c	Cs€|j ||¡}|jX|j |i¡|j| |d¡}|j| |ttjdt	 
¡|tdœ¡Wdƒn1sr0Y|S)N)Úmaxsize)r‡ÚlrulockrJÚwrites_before_update_manifest)r†r}rˆr‡rñrrrMr'r r¡ÚNUMBER_UPLOADS_BEFORE_FLUSH)rrrJr|r€ÚitemrTrTrUr}Ms
ü&zFuseCache.object_openTc	Cs°t d|t ¡jf¡|j||}|d}|dTz0| ¡\}}|dr:|j |||d|¡q:Wnt	yzYn0Wdƒn1s0Y|r¬|j 
||¡dS)NzCache object_flush [%s] [%x]r‡rŠréÚdata)rRrr r¶r·r‡Úpopitemr†rÚKeyErrorrÿ)rrrJr€Úupdate_manifestrÚcacher~rTrTrUÚobject_flush]s$ÿÿ
ÿ
$zFuseCache.object_flushcCsŽt d|t ¡jf¡|j||dd|j>|j| |d¡t	|j|ƒs^|j |d¡Wdƒn1sr0Y|j
 ||¡dS)NzCache object_close [%s] [%x]F)r‘)rRrr r¶r·r“rˆr‡rrr†r†r…rTrTrUr†tsÿÿ,zFuseCache.object_closeNcCs|j |||¡dSrX)r†r‰r‡rTrTrUr‰szFuseCache.object_truncateccsR|dkrN|tjtj}||}t|tj|ƒ}|||fV||7}||8}qdSr)rMr&r)rrr‚rˆZ
seg_offsetÚbaseÚseg_lenrTrTrUÚ_walk_segments„sÿzFuseCache._walk_segmentscCs²tƒ}|j||d~| ||¡D]^\}}}z |j||d|d}	WntyrzÆ|j||d}
t|
ƒtjkrü|
 ¡\}}|drü|j 	|||d|¡|j||dd8<|j||dsü|j 
||¡t|j||d<|j |||¡}	d|	dœ|j||d|<WnBt
yl}
z(t |
¡WYd}
~
YWdƒd	Sd}
~
00Yn0||	|||…7}q(Wdƒn1s 0Yt|ƒS)
NrŠr‡rŽrér‹rF©rérŽr)r0r‡r–r[rrMr'rr†rrÿrŒrƒr¹rRrºra)rrrJrˆr‚r€Z
output_bufÚ	segoffsetr”r•Úsegdatar’r~rrrTrTrUÚobject_readsr	ÿÿÿÿÿ
ÿÿþÿÿþÿÿþÿÿÿÿ
.6zFuseCache.object_readc
Csât d|t ¡jf¡t|ƒ}d}|j||d| ||¡D]p\}}}	|j||d}
||
vrTt|
ƒtj	krò|
 
¡\}}|drò|j |||d|¡|j||dd8<|j||dsò|j 
||¡t|j||d<z4|j |||¡}
|
durtd	ƒ‚d
|
dœ|
|<Wn*tyPtdƒ}
d|
dœ|
|<Yn0n|
|d}
t|
ƒ|krˆ|
 d
||	t|
ƒ¡||||	…|
|||	…<d|
|d<||	7}qFWdƒn1sÐ0Yt|ƒS)NzCache object_write [%s] [%x]rrŠr‡rérŽr‹rzObject not foundFr—Tó)rRrr r¶r·rr‡r–rMr'rr†rrÿrŒrƒr¹r[r0Úextend)rrrJrr‚r€rˆZbufptrr˜r”r•r’r~rr™rTrTrUÚobject_writeÊsbÿÿÿ
ÿÿþÿþÿÿ
*zFuseCache.object_writecCst |j |¡|¡SrX)rOrPr†rwrrTrTrUrPszFuseCache.mkdircCs|j |¡}t |¡SrX)r†rwrOrg)rrrPrrTrTrUrg!szFuseCache.rmdircCs|j |¡}t ||¡SrX)r†rwrOrq)rrrPrŽrrTrTrUrq%szFuseCache.chmodcCs|j |¡}t |||¡SrX)r†rwrOrr)rrrPrsrtrrTrTrUrr)szFuseCache.chown)T)N)r“r”r•rsr}r“r†r‰r–ršrrPrgrqrrrTrTrTrUr„6s

;Tr„c@söeZdZd:dd„Zdd„Zdd„Zdd	„Zd;d
d„Zdd
„Zdd„Z	dd„Z
dd„Zdd„Zdd„Z
dd„Zdd„Zdd„Zdd„Zd d!„Zd"d#„Zd$d%„Zd&d'„Zd<d(d)„Zd*d+„Zd=d,d-„Zd.d/„Zd0d1„Zd>d2d3„Zd4d5„Zd6d7„Zd8d9„ZdS)?ÚTrilioVaultNcCs&||_|pt|ƒ|_t||jƒ|_dSrX)rpr–r†r„r’)rrrpr†rTrTrUrs/szTrilioVault.__init__cCs|j ||¡dSrX)r†rrrTrTrUÚaccess7szTrilioVault.accesscCs|j ||¡SrX)r†rqrrTrTrUrq:szTrilioVault.chmodcCs|j |||¡SrX)r†rr)rrrPrsrtrTrTrUrr=szTrilioVault.chowncCs|j ||¡SrX)r†rŠr‹rTrTrUr7@szTrilioVault.getattrcCs|j |||¡SrX)r†r])rrrPrårÔrLrTrTrUÚsetxattrCszTrilioVault.setxattrcCs,| d¡s| d¡rtddƒS|j ||¡S)NZsecurityÚsystemr)rX)rurar†rb©rrrPrårTrTrUÚgetxattrFs
zTrilioVault.getxattrcCs|j |¡SrX)r†r`rrTrTrUÚ	listxattrKszTrilioVault.listxattrcCs|j ||¡SrX)r†r^r¢rTrTrUÚremovexattrNszTrilioVault.removexattrccs0ddg}| |j ||¡¡|D]
}|Vq dS)Nrçz..)rœr†rŒ)rrrPr€rdrerTrTrUÚreaddirQszTrilioVault.readdircCs2t | |¡¡}| d¡r*tj ||j¡S|SdS)Nre)rOÚreadlinkrwrurPÚrelpathrp)rrrPÚpathnamerTrTrUr§Ws
zTrilioVault.readlinkcCst |j |¡||¡SrX)rOÚmknodr†rw)rrrPrŽÚdevrTrTrUrªiszTrilioVault.mknodcCs|j |¡SrX)r†rgrrTrTrUrglszTrilioVault.rmdircCs|j ||¡SrX)r†rPrrTrTrUrPoszTrilioVault.mkdircCs|j |¡SrX)r†r’rrTrTrUÚstatfsrszTrilioVault.statfscCs|j |¡SrX)r†r‘rrTrTrUÚunlinkuszTrilioVault.unlinkcCs|j ||¡SrX)r†rwrurTrTrUrwxszTrilioVault.symlinkcCs|j ||¡SrX)r†r|)rrrzr{rTrTrUr|{szTrilioVault.renamecCs|j ||¡SrX)r†r})rrrvrårTrTrUr}~szTrilioVault.linkcCs|j ||¡SrX)r†r€)rrrPrrTrTrUr€szTrilioVault.utimenscCs|j ||¡SrX)r’r}rrTrTrUrú‡szTrilioVault.opencCs| |tj¡SrX)rúrOÚO_CREAT)rrrPrŽÚfirTrTrUÚcreateŠszTrilioVault.createcCs|j ||||¡}|SrX)r’rš)rrrPrˆr‚r€rrTrTrUÚreadszTrilioVault.readcCs|j ||||¡SrX)r’r)rrrPrr‚r€rTrTrUrû‘szTrilioVault.writecCs|jj|||ddS)N)r€)r’r‰)rrrPrˆr€rTrTrUÚtruncate”szTrilioVault.truncatecCs|j ||¡dSrX)r’r“r‹rTrTrUÚflush—szTrilioVault.flushcCs|j ||¡dSrX)r’r†r‹rTrTrUÚreleasešszTrilioVault.releasecCst d|¡|j |¡S)Nzdestroy, %s)rRrr†r‚rrTrTrUr‚¡szTrilioVault.destroy)N)N)N)N)N)r“r”r•rsrŸrqrrr7r r£r¤r¥r¦r§rªrgrPr¬r­rwr|r}r€rúr°r±rûr²r³r´r‚rTrTrTrUrž.s8




ržú/etc/fuse.confcCsd}tj |¡r\t|dƒ2}|D]}d|vr d|vr d}q>q Wdƒn1sR0Y|dkrd}tj |¡r°t|dƒ }| ¡dd}Wdƒn1s¦0Ytd	d
ƒ}| |¡Wdƒn1sÚ0Yt d	|¡t d	¡t 	ddg¡dS)
NrreZuser_allow_otherú#rzuser_allow_other 
ZrtÚ
z/tmp/fuse.conf.tmpZwtrµz	root:root)
rOrPrQrúr±rûr;rÌr!rr)Z	conf_fileÚfoundrÚlineÚsZoutfrTrTrUÚ	fuse_conf¦s"$
.(
r»c
CsRzÊzt |dg¡Wnty&Yn0tj |¡r€t |¡}ttƒj	}tt
ƒj}|j|krf|j
|ksÈt |dtdt
g¡nHt |dg¡t |dg¡t |tdt
g¡t |tdt
g¡Wn.tyø}zt |¡WYd}~n
d}~00dd„t tj¡Dƒt|t|ƒd}d}tj ¡d	kr8d
}t|||ddddddS)Nz-lz-Rr…z-pcSs&g|]}tjtj tj|¡dd‘qS)TrN)rQrRrOrPrhrMr")r9ÚxrTrTrUÚ
<listcomp>Ósýÿzmain.<locals>.<listcomp>)r†TrKF)Z	nothreadsZ
foregroundZnonemptyZ
big_writesZallow_other)r;Zumountr[rOrPrGrrr˜r™Ú
FUSE_GROUPršrCr?rrrPr¹rRrºÚlistdirrMr"ržr–r5rNr)Z
mountpointZ	cacherootZmountpoint_statr@r›rZtvaultpluginZdisable_fuse_threadsrTrTrUÚmainºsJ



ÿ 
üÿùrÀcCs<tƒtƒt t¡}| t¡| t¡ttj	tj
ƒdS)z$Main routine that drives fuse mount.N)rVr»rrrLZvalidate_s3_clientZset_retention_moderÀrMr!r")Z	s3backendrTrTrUr½ìs


r½Ú__main__)rµ)^r¾rOÚgrpÚsysrnrõZgetpassrrÌrürQrar rÚpwdrrrÚImportErrorZqueueZ
cachetoolsrZfuserr	r
r[ZfusepyZbotocore.exceptionsrZs3fuse.bunch_p3rZoslo_configr
Zoslo.configZs3fuserrYZs3fuse.utilsrrrZ_DEFAULT_LOG_DATE_FORMATrvZQUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZ
vault_optsrMZ
register_optsZregister_cli_optsrÚenvironÚflagÚargvZlist_all_sectionsZsectionsZs3fuse.privsepr;r<ZSetupS3FuseLoggingrRr¸rLrVZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetuserr˜ÚgetgrgidÚgetgidÚgr_namer¾r/rŒrcrlrnÚobjectror–r„ržr»rÀr½r“rTrTrTrUÚ<module>sä
üüøý	ÿü
üüýýÓ5ÿýÿýïýýýýûüýüöÿýýý·Qþÿþþþþþþýþþþþþþþþþþþþþþþþþþþ­Z





ÿ
ô


Ü(%
45yx
2