Why Gemfury? Push, build, and install  RubyGems npm packages Python packages Maven artifacts PHP packages Go Modules Debian packages RPM packages NuGet packages

triliodata-orange-4-2 / python3-s3fuse-plugin-el9 rpm

Repository URL to install this package:

Version: 
4.2.64.3-4.2  ▾
Details    
python3-s3fuse-plugin-el9 / usr / lib / python3.9 / site-packages / s3fuse / __pycache__ / s3vaultfuse.cpython-39.opt-1.pyc
Size: Mime: 
a

`td¯Eã'@s|dZddlZddlZddlZddlZddlZddlZddlmZddlZddl	Z	ddl
Z
ddlZddlZddlm
Z
ddlmZzddlmZmZWn"ey¶ddlmZmZYn0ddlmZzddlmZmZmZWn(eyddlmZmZmZYn0dd	lmZdd
lmZzddl m!Z!Wn eyNddl"m!Z!Yn0ddl#m$Z%dd
l&m'Z'ddl(m)Z)ddl(m*Z*dZ+dZ,dZ-dZ.e!j/ddddde!j/dddddgZ0e!j1dddde!j1d dd!de!j1d"dd#de!j1d$dd%d&d'e!j1d(e+d)d*d'e!j1d+dd,d-d.e!j1d/d0d1d2e!j/d3dd4d5e!j1d6d7d8d5g	Z2e!j/d9d:d;d5e!j/d<dd=d5e!j/d>dd?d5e!j/d@ddAd5e!j3dBdCdDd5gZ4e!j3dEdFdGd5e!j3dHdIdJd5e!j1dKdLdMd5e!j1dNdOdPd5e!j1dQdRdSd5e!j1dTdUdVd5e!j1dWdXdYd5e!j1dZd[d\d5e!j5d]gd^¢d_d5e!j/d`ddad5e!j/dbddcd5e!j1dddedfd5e!j1dgdedhd5e!j3diddjd5gZ6e!j1dkdldmd5e!j1dndodpe!j1dqdrdod5e!j3dse-dtd5e!j3due.dvd5e!j3dwdxdyd5e!j3dzd{d|d5e!j3d}dd~d5e!j1dd€ddd'e!j1d‚dƒd„d5e!j1d…d†d‡d5e!j1dˆd†d‰d5e!j1dŠd†d‹d5e!j1dŒd†dd5e!j1dŽd†dd5e!j1dd‘d’d5e!j1d“e'ƒd”d5e!j1d•d–d—d5e!j1d˜d™dšd5e!j1d›dœdd5e!j1dždœdŸd5e!j1d d¡d¢d5e!j1d£d¤d¥d5e!j1d¦d§d¨d5e!j1d©dªd«d5e!j/d¬dd­d5e!j/d®dd¯d5gZ7e!j8Z8e8 9e7¡e8 :e2¡e8 :e4¡e8 :e6¡e8 :e0¡ze;ej<d°ƒZ=e8e=gƒWn&eyLe8ej>dCd…ƒYn0d±e8 ?¡vsjd±e* @¡vrxdd²lAmBZBndd³l(mCZBe% De!j8e8jE F¡¡e% Ge8jE F¡¡ZHzre8jI F¡dkrÊeHjJ Ke%jL¡nNe8jI F¡d´krêeHjJ Ke%jM¡n.e8jI F¡dµkr
eHjJ Ke%jN¡neHjJ Ke%jO¡Wn$ey>eHjJ Ke%j%jO¡Yn0ddCgd¶dddddddddddddd·œ
d:dd†d†ej< Pd¸¡ej< Pd¹¡ej< Pdº¡d†d†dd:ddd†d†d†ddddgddd:ddd:d»d»d»d»ddd¼œ&ZQd½d¾„ZRd»ZSd¿ZTe U¡ZVe We X¡¡jYZZdÀZ[dÁZ\dÂdÄZ]dÄdńZ^dÆdDŽZ_GdÈdɄdÉe`ƒZaGdÊd˄dËeaƒZbGdÌd̈́dÍe`ƒZcGdÎdτdÏeƒZddØdÑd҄ZedÓdԄZfdÕdքZgehd×krxegƒdS)Ùad Trilio Fuse plugin implimentation

    This module is based on the vaultfuse.py module and will eventually
    become the new vaultfuse.py module once integration and refactoring
    of the existing vaultswift.py is complete.

    Currently this module is temporary for the 2.6 release and will be merged
    into a new vaultfuse.py for the next release.
éN)Údatetime)ÚThread)Úgetpwnam)ÚQueueÚEmpty)ÚLRUCache)ÚFUSEÚFuseOSErrorÚ
Operations)ÚClientError)Úbunchify)Úcfg)Úlog)Úget_ssl_cert_path)Úvaults3)Ú
config_parserz%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2édéÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarrzlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated.  Please use logging_context_format_string and logging_default_format_string instead.)rrrzlog-date-formatZDATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)rÚdeprecated_namerzlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)rrz
use-syslogzUse syslog for logging.)rrzsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTzLog output to standard errorZuse_journalz%Enable Systemd native journal supportZuse_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_burstézBurst limitZlog_rotate_intervaléz0Interval, number of hours, of log rate limiting.Zmax_logfile_counté<zNumber of log files to retain.Zlog_rotate_interval_typeZHourszUnits of log rotation intervalZlog_rotation_typeÚintervalztype of log retentionZlogging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZlogging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levels)zamqplib=WARNzsqlalchemy=WARNz	boto=WARNz	suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Úvault_storage_typeZs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)rÚvault_data_directory_oldz/var/triliovaultÚqueue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_countéz(The number of times we retry on failuresÚvault_segment_sizeizvault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileZvault_s3_auth_versionZDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚz	S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez	S3 RegionÚvault_s3_bucketz	S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚvault_s3_sslÚFalsezEnable SSL certificateÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionrzS3 signature version to useÚvault_s3_read_timeoutZ30z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolÚTruezEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Úvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).Úvault_s3_max_pool_connectionsÚ500z>The maximum number of connections to keep in a connection poolÚbucket_object_lockz#S3 bucket object locking is enabledÚuse_manifest_suffixzyTo preserve backward compatibility, set this to False.When set to False, s3fuse creates manifest file nameswithout suffixZFLAGZs3fuse_sys_admin)Úfs)ÚutilsÚinfoÚwarnú1.0)
Zproject_nameÚregion_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ	tenant_idZservice_typeZ
project_idZ
auth_tokenZproject_domain_nameZ	OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_torÚheaderÚauth_versionÚ
os_optionsZssl_compressionZos_storage_urlZos_usernameZos_passwordZ	os_cacertZos_certZos_keyZos_tenant_nameZos_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclr>ZretriesZ	write_aclÚmetarZuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚobject_namecCsâdtd<tjtd<tjtd<tjtd<tjtd<tjtd<tjtd<tjtd	<tj	td
<dtd<d
td<tj
r|tj
tdd<tjrtjtdd<tj 
¡dkr¸t dtj¡dtd<n&tj 
¡dkrÞtj tj¡rÞtjtd<dS)Nr@rFrHrIZbucketZs3_signatureZs3_read_timeoutr8r:r;r*Zs3_ssl_certZ
GOVERNANCEZretention_moderGrBrAZfalsezcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connectionÚtrue)ÚoptionsÚCONFr)r+r-r2r3r8r:r;r.r,r/ÚlowerÚLOGr?r1ÚosÚpathÚexists©rUrUú6/usr/lib/python3.9/site-packages/s3fuse/s3vaultfuse.pyÚ
option_configs8




ÿ

ÿ
ýÿ
ÿrWéz
%016x.%08xiècst ˆ¡‡fdd„ƒ}|S)Ncs~ztj tj¡Wn"ty4tj tjj¡Yn0ˆ|i|¤Ž}ztj tj¡Wn"tyxtj tjj¡Yn0|S©N)ÚloggingÚdisableÚERRORÚ
BaseExceptionZNOTSET)ÚargsÚkwargsÚresult©ÚfuncrUrVÚwrapper¼sz disable_logging.<locals>.wrapper)Ú	functoolsÚwraps)rbrcrUrarVÚdisable_logging»srfcCsRtj |¡\}}d}|dvrJ|dkr4tj ||¡}n|}tj |¡\}}q||fS©Nr*)r*ú/©rRrSÚsplitÚjoin)rSÚheadÚtailÚprefixrUrUrVÚsplit_head_tailËsrocCstj |¡\}}|SrY©rRrSrj)rSrlrmrUrUrVÚget_headØsrqc@s€eZdZdd„Zdd„Zdd„Zdd„Zd	d
„Zdd„Zd
d„Z	dd„Z
ddd„Zddd„Zdd„Z
dd„Zdd„Zdd„ZdS) ÚObjectRepositorycKs
||_dSrY)Úroot©Úselfrsr_rUrUrVÚ__init__ÞszObjectRepository.__init__cCs.| d¡r|dd…}tj t|¡}| |¡S©Nrhr)Ú
startswithrRrSrkÚ_SEGMENT_PREFIXÚ
_full_path©ruÚpartialrSrUrUrVÚ_full_segment_pathâs
z#ObjectRepository._full_segment_pathcCs*| d¡r|dd…}tj |j|¡}|Srw©rxrRrSrkrsr{rUrUrVrzés
zObjectRepository._full_pathcCsdSrYrU)rurLÚflagsrUrUrVÚobject_openïszObjectRepository.object_opencCsdSrYrU)rurLÚoffÚbufÚfhrUrUrVÚ
object_uploadòszObjectRepository.object_uploadcCsdSrYrU)rurLÚoffsetrƒrUrUrVÚobject_downloadõsz ObjectRepository.object_downloadcCsdSrYrU)rurLrUrUrVÚ
object_deleteøszObjectRepository.object_deletecCsdSrYrU©rurLrƒrUrUrVÚobject_closeûszObjectRepository.object_closeNcCsdSrYrU©rurLÚlengthrƒrUrUrVÚobject_truncateþsz ObjectRepository.object_truncatecCsdSrYrUrˆrUrUrVÚobject_getattrszObjectRepository.object_getattrcCsdSrYrU©rurSrƒrUrUrVÚobject_readdirszObjectRepository.object_readdircCsdSrYrU©rurSÚmoderUrUrVÚ
object_accessszObjectRepository.object_accesscCsdSrYrU©rurSrUrUrVÚ
object_unlink
szObjectRepository.object_unlinkcCsdSrYrUr“rUrUrVÚ
object_statfs
szObjectRepository.object_statfs)N)N)Ú__name__Ú
__module__Ú__qualname__rvr}rzr€r„r†r‡r‰rŒrrr’r”r•rUrUrUrVrrÝs

rrcsŒeZdZ‡fdd„ZGdd„deƒZGdd„dƒZdd„Zd	d
„Zdd„Z	d
d„Z
dd„Zifdd„Zdd„Z
dd„Zdd„Zdd„Zdd„Zdd„Zdd „Zd!d"„Zed#d$„ƒZd%d&„ZdYd(d)„Zd*d+„Zd,d-„Zd.d/„Zd0d1„ZdZd2d3„Zd4d5„Zd6d7„Zd8d9„Z d:d;„Z!d<d=„Z"d>d?„Z#d@dA„Z$d[dCdD„Z%dEdF„Z&d\dGdH„Z'dIdJ„Z(dKdL„Z)dMdN„Z*dOdP„Z+dQdR„Z,dSdT„Z-d]dUdV„Z.dWdX„Z/‡Z0S)^ÚBackendRepositorycsvtt|ƒj|fi|¤Žttƒj|_ttƒj|_i|_	t
 t¡|_
i|_t ¡|_i|_i|_i|_| dt¡|_dS)Nr)Úsuperr™rvrÚ	FUSE_USERÚpw_uidrCÚpw_gidÚgroup_idÚmanifestrÚ	S3BackendrNÚ_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ	threadingÚLockÚ#_BackendRepository__open_close_lockÚ_BackendRepository__in_openÚ_BackendRepository__worker_poolÚ_BackendRepository__pending_iosÚBackendWorkerPoolÚ,_BackendRepository__object_open_backend_poolrt©Ú	__class__rUrVrvs
zBackendRepository.__init__c@s0eZdZdZdd„Zdd„Zdd„Zdd	„Zd
S)zBackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
        cCs8t |¡t |¡|_||_t ¡|_d|_	| 
¡dS)NT)rrvrr Ú_BackendWorker__backendÚ_BackendWorker__job_queuer£ÚEventÚ_stop_eventÚdaemonÚstart)ruÚ	job_queuerNrUrUrVrv4s

z(BackendRepository.BackendWorker.__init__cCs|j ¡dSrY)r°Úset©rurUrUrVÚstop>sz$BackendRepository.BackendWorker.stopcCs
|j ¡SrY)r°Úis_setrµrUrUrVÚstoppedAsz'BackendRepository.BackendWorker.stoppedc
Cs²t dt ¡j¡| ¡s®zL|j dd¡\}}}z&||jg|¢Ri|¤ŽW|j 	¡n|j 	¡0Wqt
y~YqYqtyª}zt |¡WYd}~qd}~00qdS)zO Start up the worker and block until there is an item in the queue
            zStarting worker thread[%x].TrN)
rQr>r£Úcurrent_threadÚidentr¸r®Úgetr­Z	task_donerÚ	ExceptionÚ	exception)rurbr^ÚkargsÚerUrUrVÚrunDsÿÿz#BackendRepository.BackendWorker.runN)r–r—r˜Ú__doc__rvr¶r¸rÀrUrUrUrVÚ
BackendWorker0s

rÂc@s8eZdZdZdd„Zdd„Zdd„Zdd	„Zd
d„ZdS)
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
        cCs:ttjƒ|_g|_t|ƒD]}|j t |j|¡¡qdSrY)	rrOr$r³ÚworkersÚrangeÚappendr™rÂ)ruZnum_threadsrNÚ_rUrUrVrv]sÿz,BackendRepository.BackendWorkerPool.__init__cCs,|jD]}| ¡q|jD]}| ¡qdSrY)rÃr¶rk)ruÚtrUrUrVÚ__del__es


z+BackendRepository.BackendWorkerPool.__del__cOs|j |||f¡dS)z+ Add a job to the worker queue
            N)r³Zput)rurbr^r¾rUrUrVÚadd_joblsz+BackendRepository.BackendWorkerPool.add_jobcCs|D]}| ||¡qdS)z4 Add a list of jobs to the worker queue
            N)rÉ)rurbZ	args_listr^rUrUrVÚmapqsz'BackendRepository.BackendWorkerPool.mapcCs|j ¡dS)z> Wait for completion of all the jobs in the queue
            N)r³rkrµrUrUrVÚwait_completionwsz3BackendRepository.BackendWorkerPool.wait_completionN)	r–r—r˜rÁrvrÈrÉrÊrËrUrUrUrVr©Ysr©cCsRtj |¡\}}d}|dvrJ|dkr4tj ||¡}n|}tj |¡\}}q||fSrgri)rurSrlrmrnrUrUrVro|sz!BackendRepository.split_head_tailcCstj |¡\}}|SrYrp)rurSrlrmrUrUrVÚ	_get_headˆszBackendRepository._get_headcCs.| d¡r|dd…}tj t|¡}| |¡Srw)rxrRrSrkryÚ
_get_cacher{rUrUrVÚ_get_segment_cacheŒs
z$BackendRepository._get_segment_cachecCs*| d¡r|dd…}tj |j|¡}|Srwr~r{rUrUrVr͒s
zBackendRepository._get_cachecCs6| |¡\}}t ¡}||d<t|ƒ}|j |¡}|S)NrL)rorNÚcopyrr¡Zget_object_manifest)rurLÚ	containerrnÚ_optsrŸrUrUrVÚ_read_object_manifest˜sz'BackendRepository._read_object_manifestc
Csd| |¡\}}i}d|d<t ¡}||d<| ¡D]\}}	|	|d|<q2t|ƒ}|j |||¡dS)NrMzx-static-large-objectrLúx-object-meta-)rorNrÏÚitemsrr¡Zupload_object_manifest)
rurLÚobject_manifestÚmetadatarÐrnZput_headersrÑrIÚvaluerUrUrVÚ_write_object_manifest sÿz(BackendRepository._write_object_manifestcCsBt d|¡t ¡}t|ƒ}t| d¡dg}|j ||¡dS)Nú	mkdir, %srhú	-segments)	rQrrNrÏrryÚlstripr¡Úmkdir_object)rurLrÑr^rUrUrVÚ_create_segments_folder±s
z)BackendRepository._create_segments_folderc
CsÎ| |¡\}}t ¡}|dkr$g}n|g}d|d<d|d<d|d<d|d<d|d<t|ƒ}|dkrv||d<| |¡nd}|j ||¡}i}|dd	 ¡D],\}}	d
|vrÀ|	|| d
¡d<qœ|	||<qœ|S)Nr*Ú	delimiterFÚhumanÚtotalsÚlongrnÚheadersZMetadatarÓr)	rorNrÏrrÅr¡Ústat_objectrÔrj)
rurLrÐrnrÑr^ÚstrÖrIr×rUrUrVÚ_get_object_metadata¹s,
z&BackendRepository._get_object_metadatacCs| |¡\}}| |¡}|tddƒ@tjk}|jB|j |t 	¡¡|j
 |d¡|j
|d7<Wdƒn1sz0Y|j|\|j |i¡|j |i¡||j
vr|tddƒ@tjksð|tj@tjksð|tj@tjkrLz| |¡}Wn6ty4t d|¡t d¡| |¡}Yn0dii|j
|<|D]V}|d d	¡d}	|	 d
¡d}	t|	dƒ}
| dd¡|d<d
|d<||j
||
<qH| |¡}|j
| |¡z&| |j
|d¡}tj|ddWntyôYn0tjtj |¡ddt|dƒ }
|
 t  !|¡¡Wdƒn1s>0YnÐtjtj |¡dd|tj"@tj"krÞz| #|¡Wnty–Yn0z0t|dƒ}
Wdƒn1s¼0YWntyÜYn0z | $|d¡}tj|ddWntyYn0t ||¡}z€| %|¡|j&|j||<dii|j
|<dd
i|j
|d|<| '||¡W|j| (|d¡|j
|d (|d¡t )|¡n4|j| (|d¡|j
|d (|d¡t )|¡0z0t|dƒ}
Wdƒn1sú0YWntyYn0zddl*m+}||ƒ ,¡WntyLYn0t ||¡}zDzŽd|i|j
|d|<| -t.j/t0¡|j||<t1ƒ|j||<|WW|j"|j
|d8<Wdƒn1sÔ0YWdƒStyb}z\t 2|¡|j| (|d¡|j
|d (|d¡|j| (|d¡t )|¡‚WYd}~n
d}~00W|j"|j
|d8<Wdƒn1s–0Yn<|j"|j
|d8<Wdƒn1sÒ0Y0Wdƒn1sô0YdS)NZfférrz+Manifest for %s not found. Trying in 5 secsrÚopen_handlesÚnameú
-segments/Ú.Ú	versionIdr*FÚmodifiedúsegments-dirT)Úexist_okÚwrÚÚreadonly)ÚPath)3rorzÚintrRÚO_RDONLYr¥r¢Ú
setdefaultr£ÚRLockr¦r§r¨rŸÚO_RDWRÚO_APPENDrÒr¼rQr>ÚtimeÚsleeprjr»råÚupdateÚmakedirsr]rSÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_WRONLYr”r}rÝrªÚ
_object_closeÚpopÚcloseÚpathlibrñÚtouchr©rOr%rNr´r½)rurLrrÐrnÚ	full_pathrðrŸÚsegZoffstrr…rÖZsegment_dirÚfrƒrñÚexrUrUrVr€õs
ÿÿ0ÿþýÿÿÿ

ÿ4ÿ$ÿ
ÿÿÿÿÿÿýÿÿ$ÿÿÿÿ	2ö

4ÿzBackendRepository.object_openc
CsTz t ¡}t|ƒ}| ||¡Wn.tyN}zt |¡WYd}~n
d}~00dS)zý Utility method to be dispatched to a worker
            thread in order to clean up old segments.

        Args:
            backend (class instance): Instance of the backend plugin.
            segment_list (list): List of segments to remove.
        N)rNrÏrÚdelete_object_listr¼rQr½)ruÚbackendÚsegment_listrÑr
rUrUrVZ__purge_old_segments_task‰sz+BackendRepository.__purge_old_segments_taskcCsî|j|| ¡|j|ºzv|j| ddt|d¡}| |¡\}}g}d}|j|d|dsˆd}d}	d}
||j|vrŽqºz| |j||d|¡}Wn6tyât	 
d¡| |j||d|¡}Yn0|j||d	r:t|ƒ}t|j
tjƒ}
| |j||d|j|j|
|jd
œ¡nd|j||d}
| |j||d|j|| dd
¡|j||d|
|j||dd
œ¡|tj7}|d7}|	|
7}	q||j|||t|ƒt|	ƒdœdd}|rˆ| |||¡}
t|
ƒdkrqˆt|
ƒ}
z|j||d}Wnd
}Yn0| d¡}tt|
ƒt|gƒƒ}t|ƒdkrz|j|| |j|¡|tj7}qÞWWdƒdStyÈ}zt  |¡WYd}~n
d}~00Wdƒn1sà0YdS)zé Handle object_close by updating the manifest.

         Waits for all of the background jobs to complete prior to updating
         manifest using the main thread. Also queues up tasks to clean up
         any old segments.
        rírhrÚrrçrðrèrrì)rSrëÚetagÚ
size_bytesÚcontent_typerrër*Úhashrr©ríú
segment-countú
total-size©rÖTN)!r§rËr¢rŸr»ryrorr]rørùrÚminÚst_sizerOr'rÅÚ
version_idrrrØÚstrr
ÚlenÚsortedÚstripÚlistr´rÉÚ+_BackendRepository__purge_old_segments_taskr¼rQr½)rurLrƒÚsegments_dirrÐrnrÕÚsegmentsr…Z
total_sizeÚsegment_sizeräÚstatZobjectsÚpZ
purge_listr
rUrUrVr˜sÎ
þÿÿÿþ
þ
ÿÿùÿÿÿÿÿÿÿþöÿ

ýý


þzBackendRepository._object_closec	CsT| ||¡|j|&| ||¡|j| |¡|j| |¡|j|d |¡zt |¡WntyzYn0t	|j|dƒdkrâz0|j |d¡}|j |d¡}t 
| |¡¡WntyÔYn0|j |¡|j6|j
|s||jvr|j |d¡Wdƒn1s&0YWdƒn1sF0YdS)Nrçr)rr¢r§rr¨rŸrRrr]rÚremoverzr¥r¦)rurLrƒZohZpiosrUrUrVr‰s,zBackendRepository.object_closec
Cs~|j|\z||j|vrJ|j||ddurJ|j||d}n8| ||¡}|j| ddt|d¡}tj ||¡}t 	¡}d|j|v|d<| 
|¡\}	}
t|ƒ|d	<|
 d¡|d
<t
|ƒ}|	||d	g}|j|| |¡|j|| |j||||||¡WnFtyX}z,t |¡|j|| |¡‚WYd}~n
d}~00Wdƒn1sp0YdS)NrìTrèrírhrÚÚ0Ú
path_validr!rL)r¢rŸÚ,_BackendRepository__next_segname_from_offsetr»ryrRrSrkrNrÏrorÚrstriprr¨Úaddr§rÉÚ&_BackendRepository__object_upload_taskr¼rQr½r$)
rurLr…r‚rƒÚseg_fullnameZsegnamerrÑrÐÚobjÚargs1r
rUrUrVr„)s@ÿþÿ
þý
zBackendRepository.object_uploadcCsŠt d||t ¡jf¡|d}|d}	|dd…}|j|Wdƒn1sV0Yzd|_| |||	|¡}
Wnntyè}zVt 	|¡|j|$|j
|| |¡Wdƒn1sÈ0Y‚WYd}~n
d}~00|j|€||j|vri|j||<||j||d<d|j||d<|
 
dd	¡|j||d
<|j
|| |¡Wdƒn1s|0YdS)zP Method run by a worker in the thread pool to upload an object segment.
        z6Object [%s] segment [%s] upload running in thread[%x].rr&NTrèrìÚ	VersionIdr*rë)rQr>r£r¹rºr¢r&Z
put_objectr¼r½r¨r$rŸr»)rurr-rÑrLr…r+rƒr‚Zbuf_lenZrespr
rUrUrVZ__object_upload_taskPs4ÿÿ
2
ÿz&BackendRepository.__object_upload_taskc
Cs6t d¡|j|~||j||vr6Wdƒq||j|vrdtd|tt|ƒtdƒfƒ‚|j||d}Wdƒq¤Wdƒq1s˜0Yq| | 	d¡¡\}}i}|j|| 
dd¡|d<t|ƒ}||g}z|j 
||¡}	t|	ƒWSty0}
zt |
¡‚WYd}
~
n
d}
~
00dS)	Ngš™™™™™¹?zobject %s not found rrèrhrër*r)rørùr¢r¨rŸr¼ÚSEGMENT_FORMATròror(r»rr¡Z
get_objectÚ	bytearrayrQr½)rurLr…rƒr+rÐr,rÑr-r‚r
rUrUrVr†us2
ÿÿ.ÿ

z!BackendRepository.object_downloadcCsÀ|j |t ¡¡|j|| |¡\}}t ¡}t|ƒ}|g}|dkr\|dkr\| |¡z|j	 
||¡Wn.tyœ}zt 
|¡WYd}~n
d}~00Wdƒn1s²0YdS)Nr*rh)r¢rôr£rõrorNrÏrrÅr¡Z
delete_objectr¼rQr½)rurLrÐr,rÑr-r
rUrUrVr‡“sÿ

zBackendRepository.object_deleteNcCs&|rdS| |tj¡}| ||¡dSrY)r€rRrr‰rŠrUrUrVrŒ¦sz!BackendRepository.object_truncatecCspt ¡}d|d<d|d<d|d<d|d<tj |dt|ƒ¡|d<g}|dkrTg}n|g}t|ƒ}|j ||¡S)	NrÞFrßràráz%016xrnr*)	rNrÏrRrSrkròrr¡Z
list_segments)rurÐrr…rÑr^rUrUrVr
¬szBackendRepository.segment_listc	CsÀ| |¡\}}|j| dd¡}|rT| dt¡r@| |¡\}}| |¡\}}|}n|d}| |||¡}t|ƒdkrŠtt|ƒtdƒfStt|ƒtt	|ƒd 
|¡d 
d¡ddƒdfS)	NrírhrÚréÿÿÿÿrrêræ)rorŸr»rxryr
rr/ròrrj)	rurSr…rÐrnrÚcr#ÚfilesrUrUrVZ__next_segname_from_offset¾s"$ÿþz,BackendRepository.__next_segname_from_offsetc
Cs|j|¨| |¡\}}|j |d¡rd||j|vrd|j||d}| d¡dWdƒS|j| dd¡}|rŽ| |¡\}}|}n|d}| |||¡}	Wdƒn1s¸0Yt|	ƒdkrâtt|ƒtdƒfStt|ƒtt	|	ƒd |¡d d¡dd	ƒfS)
NrèrérrírÚrr1rêræ)
r¢rorŸr»rjr
rr/ròr)
rurSr…rÐrnrrr2r#r3rUrUrVÚcurr_segname_from_offsetÓs",$þz*BackendRepository.curr_segname_from_offsetc
s†tj |¡r‚zBt |¡‰t‡fdd„dDƒƒ}d|d<t|ddƒ|d<|WSty|}zt |¡WYd}~n
d}~00dSdS)	aë Utility to check the tmpfs cache and return stat() from that.

         This method looks to see if the object (directory) exists in the
         local cache and will perform a stat() locally instead of calling
         all the way to the backend.

        Args:
            object_cache_path (str): Cache path to the object we
                                     need stat infor on.

        Returns:
            Dictionary of stat() information or None if object does not exist.
        c3s|]}|tˆ|ƒfVqdSrY©Úgetattr©Ú.0rI©rärUrVÚ	<genexpr>þsÿz0BackendRepository._stat_cache.<locals>.<genexpr>©Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkrÚst_uidéÚ
st_blksizerÚ	st_blocksN)	rRrSÚisdirÚlstatÚdictròr¼rQr½)ruZobject_cache_pathÚ	stat_infor¿rUr9rVÚ_stat_cacheìs
þ
zBackendRepository._stat_cachecs | |¡}| |¡\}}t ¡}|dkr.g}n|g}d|d<d|d<d|d<d|d<d|d<t|ƒ}i}|dkr„||d<| |¡nd}z`|j ||¡‰|j|d<|j	|d	<ˆd
 
dd¡|d<ˆd
 
d
d¡|d<ˆd
 
dd¡|d<tˆdƒ|d<tˆdƒ|d<tˆdƒ|d<d|d<d|d<|durFd|vrFd|d<tˆdƒ|d<|ddkrn|dks¬|ddkr†|dus¬|ddkrž|dks¬ˆddurèd |d<d!|d<d"|d<| |¡}	t
j |	¡sèt
 |	d#¡Wn”ty:zt
 |¡WntyYn0tj|dd$t
 |¡YnFty~}
z,t
 |¡‰t‡fd%d&„d'Dƒƒ}WYd}
~
n
d}
~
00d(|d)<t|dd(ƒ|d*<|S)+Nr*rÞFrßràrárnr>rBrâZETagrr.rZContentTyperZ	timestampr<r=r@rrAiír?Zauthorized_keyi€ÚsizerrZ	directoryTéiiýAié©Ú
ignore_errorsc3s|]}|tˆ|ƒfVqdSrYr5r7r9rUrVr:Usÿz3BackendRepository.object_getattr.<locals>.<genexpr>r;rCrDrE)rzrorNrÏrrÅr¡rãržrCr»ròrÍrRrSrTÚmkdirrr$r¼ÚshutilÚrmtreerGrH)rurLrƒrrÐrnrÑr^rZcontainer_pathr
rUr9rVrs†



ÿÿ
þþ
ýý
ü

þz BackendRepository.object_getattrc
Cs
zt |d¡}Wn0ty@}zt |¡‚WYd}~n
d}~00d}||j|vrÆz |j |j||d|¡Wn8ty¬t	 
d¡|j |j||d|¡Yn0||j||d7}qFz|j ||¡Wn,tyt	 
d¡|j ||¡Yn0dS)Nz%Y-%m-%dT%H:%M:%Srrèrr)rÚstrptimer¼rQr½rŸr¡Zput_object_segment_retentionr]rørùZput_manifest_retention)rurLÚretainuntilÚdtr
r…rUrUrVÚ_set_object_retentionjs,
ÿ
ÿ

z'BackendRepository._set_object_retentionc	
Cs2| |tj¡}zzÊ|j|¬t |j|¡}d}||j|vrj|j||d}| |d¡||7}q4| dd¡|dkr’| || 	d¡¡n| 	d¡||<|j
 ||¡||j||<Wdƒn1sÐ0YWn2ty}zt
 |¡‚WYd}~n
d}~00W| ||¡n| ||¡0dS)NrrrçrSÚutf8úutf-8)r€rRrór¢rÏÚdeepcopyrŸrrUÚdecoder¡Úupdate_object_attributesr¼rQr½r‰)	rurLrèr×rƒÚattrsr…rKr
rUrUrVÚobject_setxattrˆs.
ÿÿ0
z!BackendRepository.object_setxattrc
Cs| |tj¡}zòz°|j|’t |j|¡}d}||j|vrh|j||d}| |d¡||7}q2| |d¡| dd¡|j 	||¡|j| |d¡Wdƒn1s´0YWn0t
yð}zt |¡‚WYd}~n
d}~00W| 
||¡n| 
||¡0dS)Nrrrç)r€rRrór¢rÏrXrŸrr¡rZr¼rQr½r‰)rurLrèrƒr[r…rKr
rUrUrVÚobject_removexattr¡s&
ÿ4
z$BackendRepository.object_removexattrc
CsÈ| |tj¡}z¦zd|j|Ft |j|¡}| d¡| ¡}|WdƒWW| 	||¡S1sh0YWn0t
y¤}zt |¡‚WYd}~n
d}~00W| 	||¡n| 	||¡0dS)Nrç)
r€rRrór¢rÏrXrŸrÚkeysr‰r¼rQr½)rurLrƒr[r^r
rUrUrVÚobject_listxattr¶s
û
z"BackendRepository.object_listxattrc
Cs¶| |tj¡}z”zR|j|4t|j||dƒWdƒWW| ||¡S1sV0YWn0ty’}zt 	|¡‚WYd}~n
d}~00W| ||¡n| ||¡0dS)NrW)
r€rRrór¢ÚbytesrŸr‰r¼rQr½)rurLrèrƒr
rUrUrVÚobject_getxattrÅs$û
z!BackendRepository.object_getxattrccs\g}| d¡d}g}||j |¡7}|D]}| | d¡d¡q*t|ƒD]
}|VqLdS)Nrhr1)r(r¡Úlist_objectsrÅrjr)rurLrƒZlistingZdir_pathÚdirentsZlstÚrrUrUrVrÐsz BackendRepository.object_readdircCsdSrYrU)rurLr‘rUrUrVr’ÛszBackendRepository.object_accessFc
CsN|td<t ¡}t|ƒ}|sz¸| |¡}| |¡}g}|D]}| |d¡q<|j ||¡| d¡}|durÔ|g}	|j 	|	|¡zt
 | |¡¡Wnt
yªYn0zt
 | |¡¡Wnt
yÒYn0Wn0ty}
zt |
¡WYd}
~
n
d}
~
00z|j |¡Wn0tyH}
zt |
¡WYd}
~
n
d}
~
00dS)NrKrèrí)rNrÏrrÒrårÅr¡rr»Úrmdir_objectrRÚrmdirrÍr]r$r¼rQr½Zdelete_object_manifest)rurLrKrÑZobj_manifestZobj_metadatar
Úmanrr^r
rUrUrVr”Þs>





zBackendRepository.object_unlinkc	
CsÒt ¡}t|ƒ}g}z|j ||¡}Wn8ty^}z t |¡tt	j
ƒ‚WYd}~n
d}~00d|dvr’t|dƒ}t|dƒt|dƒ}nd}t|dƒ}i}||d<||d<||d<d	|d
<d	|d<|S)Nzx-account-meta-quota-bytesrâzx-account-bytes-usedr1rKÚf_blocksÚf_bfreeÚf_bavailrÚf_favailÚf_frsize)rNrÏrr¡rãr¼rQr½r	ÚerrnoÚENOENTrò)	rurLrÑr-Zstvr
rhrjrTrUrUrVr•s,
 ÿzBackendRepository.object_statfsc

Csât d|¡| |¡\}}t ¡}t|ƒ}||g}z|j ||¡Wn0tyv}zt 	|¡WYd}~dSd}~00| 
|¡}	|durž| 
tj 
||¡¡}	zt |	|¡Wn.tyÜ}zt 	|¡WYd}~n
d}~00dS)NrÙrF)rQrrorNrÏrr¡rÜr¼r½rÍrRrSrkrû)
rurSr‘ZistrÐr,rÑr^r
Ú
cache_pathrUrUrVrO s$

 zBackendRepository.mkdirc
Cs| |¡\}}t ¡}d|d<t|ƒ}| d¡d}g}z||jj|dd7}Wn.ty~}zt 	|¡WYd}~n
d}~00t
|ƒdkr–ttj
ƒ‚z|j | d¡g|¡Wn.tyÞ}zt 	|¡WYd}~n
d}~00tj t| d¡¡}z||jj|dd7}Wn0ty<}zt 	|¡WYd}~n
d}~00t
|ƒdkr˜z|j | d¡g|¡Wn0ty–}zt 	|¡WYd}~n
d}~00z&| |¡}	tj |	¡r¼t |	¡WntyÒYn0z&| |¡}
tj |
¡røt |
¡WntyYn0dS)Nrnrhr&)Z	max_itemsr)rorNrÏrr(r¡rbr¼rQr½rr	rmZ	ENOTEMPTYrerRrSrkryrÛrÎrFrPrQr]rÍ)rurLrÐr,rÑrSZ	dir_itemsr
Zseg_pathZsegment_cache_pathrorUrUrVrf@sR 

 


zBackendRepository.rmdircCsVt d|¡z0| |¡\}}| tj ||¡¡}t ||¡WStyPYn0dS)Nz	chmod, %s)	rQrrorÍrRrSrkÚchmodr])rurSr‘rÐrnrorUrUrVrpwszBackendRepository.chmodcCsXt d|¡z2| |¡\}}| tj ||¡¡}t |||¡WStyRYn0dS)Nz	chown, %s)	rQrrorÍrRrSrkÚchownr])rurSÚuidÚgidrÐrnrorUrUrVrq€szBackendRepository.chowncCstdƒ‚dS)NzNot Applicable)r¼©rurèÚtargetrUrUrVÚsymlink‰szBackendRepository.symlinkc
CsN|j |d¡r2t d¡|j |d¡r2td|ƒ‚t d||f¡|d}z|j|ddWn.tyŒ}zt |¡WYd}~n
d}~00zL| 	|¡}| 	|¡}| d|d¡| d|d¡krØ|j|ddWd	SWntyìYn0d
}z¤z| 	|¡}WntyYn~0| 
|¡}| d|d¡}	g}
|D]4}|
 |d|d|d
| dd¡|ddœ¡q:|j||
|	|d|ddœdd}Wn2t
yÈ}zt |¡‚WYd}~n
d}~00z0zÊ| 
|¡}| 	|¡}| d|d¡}	g}|D]4}| |d|d|d
| dd¡|ddœ¡qü|j|||	|d|ddœdz|j|ddWn0ty”}zt |¡WYd}~n
d}~00Wnt
y®‚Yn0W|rJz|j|d
dWn0tyú}zt |¡WYd}~n
d}~00nL|rHz|j|d
dWn0tyF}zt |¡WYd}~n
d}~000d	S)Néz%s in use. Try againzrename, %s -> %sú~T)rKrírÚrFrèrrrër*r)rSrrrërrrrr)rŸr»rørùr¼rQrr”r½rårÒrÅrØr])
ruÚoldÚnewZnewbak_namer
Znew_metadataZold_metadataZnewfile_existsZnew_manifestrZnewbak_manifestrgZold_manifestrUrUrVÚrenameŒs²

 

ÿ

ÿ
ýÿýÿ



ûÿ
ýý$
"ü"zBackendRepository.renamecCsZt d|¡t|ƒ\}}| tj ||¡¡}t|ƒ\}}| tj ||¡¡}t ||¡S)Nzlink, %s)rQrrorÍrRrSrkÚlink)rururèrÐrnZcache_path_targetZcache_path_namerUrUrVr|þszBackendRepository.linkcCsNt d|¡t|ƒ\}}| |¡}zt ||¡WntyHYdS0dS)Nzutimens, %sr)rQrrorÍrRÚutimer])rurSÚtimesrÐrnrorUrUrVÚutimenss
zBackendRepository.utimenscCsdS©NrrUr“rUrUrVÚdestroyszBackendRepository.destroy)N)N)F)F)N)1r–r—r˜rvrrÂr©rorÌrÎrÍrÒrØrÝrår€rrr‰r„r*rfr†r‡rŒr
r'r4rJrrUr\r]r_rarr’r”r•rOrfrprqrvr{r|rrÚ
__classcell__rUrUr«rVr™s\)#	ÿ
<s'%

*
T
#
 7		r
r™c@speZdZdd„Zdd„Zddd„Zdd	„Zddd„Zd
d„Zdd„Z	dd„Z
dd„Zdd„Zdd„Z
dd„Zd
S)Ú	FuseCachecCsÚ||_||_i|_t ¡|_ttƒj|_	ttƒj
|_tj
 |j¡sŽz4t |j¡t |jt|j	ƒdt|jƒg¡WqÖtyŠ‚YqÖ0nHt |j¡}|j|j	ks²|j|jkrÖt tjt|j	ƒdt|jƒg¡dS)Nú:)rsÚ
repositoryÚlrucacher£r¤Ú
lrucache_lockrr›rœrCrržrRrSrFr<rOrqrr]r"rBr>rOr#)rursr…rIrUrUrVrv-s*
ÿ

ÿÿzFuseCache.__init__c	Cs€|j ||¡}|jX|j |i¡|j| |d¡}|j| |ttjdt	 
¡|tdœ¡Wdƒn1sr0Y|S)N)Úmaxsize)r†ÚlrulockrLÚwrites_before_update_manifest)r…r€r‡r†rôrrrOr(r£r¤ÚNUMBER_UPLOADS_BEFORE_FLUSH)rurLrrƒÚitemrUrUrVr€Cs
ü&zFuseCache.object_openTc	Cs°t d|t ¡jf¡|j||}|d}|dTz0| ¡\}}|dr:|j |||d|¡q:Wnt	yzYn0Wdƒn1s0Y|r¬|j 
||¡dS)NzCache object_flush [%s] [%x]r†r‰rìÚdata)rQrr£r¹rºr†Úpopitemr…r„ÚKeyErrorr)rurLrƒÚupdate_manifestrŒÚcacherrUrUrVÚobject_flushSs$ÿÿ
ÿ
$zFuseCache.object_flushcCsŽt d|t ¡jf¡|j||dd|j>|j| |d¡t	|j|ƒs^|j |d¡Wdƒn1sr0Y|j
 ||¡dS)NzCache object_close [%s] [%x]F)r)rQrr£r¹rºr’r‡r†rrr…r‰rˆrUrUrVr‰jsÿÿ,zFuseCache.object_closeNcCs|j |||¡dSrY)r…rŒrŠrUrUrVrŒwszFuseCache.object_truncateccsR|dkrN|tjtj}||}t|tj|ƒ}|||fV||7}||8}qdSr€)rOr'r)rur…r‹Z
seg_offsetÚbaseÚseg_lenrUrUrVÚ_walk_segmentszsÿzFuseCache._walk_segmentscCs²tƒ}|j||d~| ||¡D]^\}}}z |j||d|d}	WntyrzÆ|j||d}
t|
ƒtjkrü|
 ¡\}}|drü|j 	|||d|¡|j||dd8<|j||dsü|j 
||¡t|j||d<|j |||¡}	d|	dœ|j||d|<WnBt
yl}
z(t |
¡WYd}
~
YWdƒd	Sd}
~
00Yn0||	|||…7}q(Wdƒn1s 0Yt|ƒS)
Nr‰r†rrìrŠrF©rìrr)r0r†r•r]rrOr(rŽr…r„rr‹r†r¼rQr½r`)rurLr‹r…rƒZ
output_bufÚ	segoffsetr“r”Úsegdatar‘rrŒr
rUrUrVÚobject_read…sr	ÿÿÿÿÿ
ÿÿþÿÿþÿÿþÿÿÿÿ
.6zFuseCache.object_readc
Csât d|t ¡jf¡t|ƒ}d}|j||d| ||¡D]p\}}}	|j||d}
||
vrTt|
ƒtj	krò|
 
¡\}}|drò|j |||d|¡|j||dd8<|j||dsò|j 
||¡t|j||d<z4|j |||¡}
|
durtd	ƒ‚d
|
dœ|
|<Wn*tyPtdƒ}
d|
dœ|
|<Yn0n|
|d}
t|
ƒ|krˆ|
 d
||	t|
ƒ¡||||	…|
|||	…<d|
|d<||	7}qFWdƒn1sÐ0Yt|ƒS)NzCache object_write [%s] [%x]rr‰r†rìrrŠrzObject not foundFr–Tó)rQrr£r¹rºrr†r•rOr(rŽr…r„rr‹r†r¼r]r0Úextend)rurLr‚r…rƒr‹Zbufptrr—r“r”r‘rrŒr˜rUrUrVÚobject_writeÀsbÿÿÿ
ÿÿþÿþÿÿ
*zFuseCache.object_writecCst |j |¡|¡SrY)rRrOr…rzrrUrUrVrOszFuseCache.mkdircCs|j |¡}t |¡SrY)r…rzrRrf)rurSrrUrUrVrfszFuseCache.rmdircCs|j |¡}t ||¡SrY)r…rzrRrp)rurSr‘rrUrUrVrpszFuseCache.chmodcCs|j |¡}t |||¡SrY)r…rzrRrq)rurSrrrsrrUrUrVrqszFuseCache.chown)T)N)r–r—r˜rvr€r’r‰rŒr•r™rœrOrfrprqrUrUrUrVrƒ,s

;Trƒc@súeZdZd:dd„Zdd„Zdd„Zdd	„Zed;d
d„ƒZdd
„Z	dd„Z
dd„Zdd„Zdd„Z
dd„Zdd„Zdd„Zdd„Zdd„Zd d!„Zd"d#„Zd$d%„Zd&d'„Zd<d(d)„Zd*d+„Zd=d,d-„Zd.d/„Zd0d1„Zd>d2d3„Zd4d5„Zd6d7„Zd8d9„ZdS)?ÚTrilioVaultNcCs&||_|pt|ƒ|_t||jƒ|_dSrY)rsr™r…rƒr‘)rursr…rUrUrVrv%szTrilioVault.__init__cCs|j ||¡dSrY)r…r’rrUrUrVÚaccess-szTrilioVault.accesscCs|j ||¡SrY)r…rprrUrUrVrp0szTrilioVault.chmodcCs|j |||¡SrY)r…rq)rurSrrrsrUrUrVrq3szTrilioVault.chowncCs|j ||¡SrY)r…rrŽrUrUrVr66szTrilioVault.getattrcCs|j |||¡SrY)r…r\)rurSrèr×rKrUrUrVÚsetxattr:szTrilioVault.setxattrcCs,| d¡s| d¡rtddƒS|j ||¡S)NZsecurityÚsystemr*rW)rxr`r…ra©rurSrèrUrUrVÚgetxattr=s
zTrilioVault.getxattrcCs|j |¡SrY)r…r_r“rUrUrVÚ	listxattrBszTrilioVault.listxattrcCs|j ||¡SrY)r…r]r¡rUrUrVÚremovexattrEszTrilioVault.removexattrccs0ddg}| |j ||¡¡|D]
}|Vq dS)Nrêz..)r›r…r)rurSrƒrcrdrUrUrVÚreaddirHszTrilioVault.readdircCs2t | |¡¡}| d¡r*tj ||j¡S|SdS)Nrh)rRÚreadlinkrzrxrSÚrelpathrs)rurSÚpathnamerUrUrVr¦Ns
zTrilioVault.readlinkcCst |j |¡||¡SrY)rRÚmknodr…rz)rurSr‘ÚdevrUrUrVr©`szTrilioVault.mknodcCs|j |¡SrY)r…rfr“rUrUrVrfcszTrilioVault.rmdircCs|j ||¡SrY)r…rOrrUrUrVrOfszTrilioVault.mkdircCs|j |¡SrY)r…r•r“rUrUrVÚstatfsiszTrilioVault.statfscCs|j |¡SrY)r…r”r“rUrUrVÚunlinklszTrilioVault.unlinkcCs|j ||¡SrY)r…rvrtrUrUrVrvoszTrilioVault.symlinkcCs|j ||¡SrY)r…r{)ruryrzrUrUrVr{rszTrilioVault.renamecCs|j ||¡SrY)r…r|)rururèrUrUrVr|uszTrilioVault.linkcCs|j ||¡SrY)r…r)rurSr~rUrUrVrxszTrilioVault.utimenscCs|j ||¡SrY)r‘r€rrUrUrVrý~szTrilioVault.opencCs| |tj¡SrY)rýrRÚO_CREAT)rurSr‘ÚfirUrUrVÚcreateszTrilioVault.createcCs|j ||||¡}|SrY)r‘r™)rurSr‹r…rƒr‚rUrUrVÚread„szTrilioVault.readcCs|j ||||¡SrY)r‘rœ)rurSr‚r…rƒrUrUrVrþˆszTrilioVault.writecCs|jj|||ddS)N)rƒ)r‘rŒ)rurSr‹rƒrUrUrVÚtruncate‹szTrilioVault.truncatecCs|j ||¡dSrY)r‘r’rŽrUrUrVÚflushŽszTrilioVault.flushcCs|j ||¡dSrY)r‘r‰rŽrUrUrVÚrelease‘szTrilioVault.releasecCst d|¡|j |¡S)Nzdestroy, %s)rQrr…rr“rUrUrVr˜szTrilioVault.destroy)N)N)N)N)N) r–r—r˜rvržrprqrfr6rŸr¢r£r¤r¥r¦r©rfrOr«r¬rvr{r|rrýr¯r°rþr±r²r³rrUrUrUrVr$s:



rú/etc/fuse.confcCsd}tj |¡r\t|dƒ2}|D]}d|vr d|vr d}q>q Wdƒn1sR0Y|dkrd}tj |¡r°t|dƒ }| ¡dd}Wdƒn1s¦0Ytd	d
ƒ}| |¡Wdƒn1sÚ0Yt d	|¡t d	¡t 	ddg¡dS)
NrrdZuser_allow_otherú#rzuser_allow_other 
ZrtÚ
z/tmp/fuse.conf.tmpZwtr´z	root:root)
rRrSrTrýr°rþr<rÏr$rq)Z	conf_fileÚfoundr	ÚlineÚsZoutfrUrUrVÚ	fuse_confs"$
.(
rºc
CsRzÊzt |dg¡Wnty&Yn0tj |¡r€t |¡}ttƒj	}tt
ƒj}|j|krf|j
|ksÈt |dtdt
g¡nHt |dg¡t |dg¡t |tdt
g¡t |tdt
g¡Wn.tyø}zt |¡WYd}~n
d}~00dd„t tj¡Dƒt|t|ƒd}d}tj ¡d	kr8d
}t|||ddddddS)Nz-lz-Rr„z-pcSs&g|]}tjtj tj|¡dd‘qS)TrM)rPrQrRrSrkrOr#)r8ÚxrUrUrVÚ
<listcomp>Êsýÿzmain.<locals>.<listcomp>)r…TrMF)Z	nothreadsZ
foregroundZnonemptyZ
big_writesZallow_other)r<Zumountr]rRrSrFr"rr›rœÚ
FUSE_GROUPrrBr>rqrOr¼rQr½ÚlistdirrOr#rr™r5rPr)Z
mountpointZ	cacherootZmountpoint_statrCržr
ZtvaultpluginZdisable_fuse_threadsrUrUrVÚmain±sJ



ÿ 
üÿùr¿cCs<tƒtƒt t¡}| t¡| t¡ttj	tj
ƒdS)z$Main routine that drives fuse mount.N)rWrºrr rNZvalidate_s3_clientZset_retention_moder¿rOr"r#)Z	s3backendrUrUrVrÀãs


rÀÚ__main__)r´)irÁrRÚgrpÚsysrmrøZgetpassrrÏrÿrPrdr£rÚpwdrrrÚImportErrorZqueueZ
cachetoolsrZfuserr	r
r]ZfusepyZbotocore.exceptionsrZs3fuse.bunch_p3rZoslo_configr
Zoslo.configZoslo_logrrZZs3fuse.utilsrZs3fuserrZ_DEFAULT_LOG_DATE_FORMATryZQUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZ
vault_optsrOZ
register_optsZregister_cli_optsrÚenvironÚflagÚargvZlist_all_sectionsZsectionsZs3fuse.privsepr<r=Zsetupr!rPZ	getLoggerrQr6ÚloggerZsetLevelÚDEBUGÚINFOZWARNr\r»rNrWZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetuserr›ÚgetgrgidÚgetgidÚgr_namer½r/r‹rfrorqÚobjectrrr™rƒrrºr¿rÀr–rUrUrUrVÚ<module>sò
üüøý	ÿü
üüýýÓ5ÿýÿýïýýýýûüýüöÿýýý·Qþÿþþþþþþýþþþþþþþþþþþþþþþþþþ°W





ÿô


Ü("
4%yy
2


Products

About

Resources

Contact Gemfury