Why Gemfury? Push, build, and install  RubyGems npm packages Python packages Maven artifacts PHP packages Go Modules Debian packages RPM packages NuGet packages

triliodata-dev-hotfix1-4-1 / python3-s3fuse-plugin rpm

Repository URL to install this package:

Version: 
4.1.94.1.dev5-4.1  ▾
Details    
python3-s3fuse-plugin / usr / lib / python3.6 / site-packages / s3fuse / __pycache__ / s3vaultfuse.cpython-36.pyc
Size: Mime: 
3

†ƒ¬`dAãK@s"dZddlZddlZddlZddlZddlZddlZddlZddlZddl	Z	ddl
Z
ddl
mZddl
mZddl
mZyddlmZmZWn$ek
r°ddlmZmZYnXddlmZddlmZydd	lmZmZmZWn dd	lmZmZmZYnXdd
lTddlZyddlmZWn"ek
rFddl mZYnXddl!m"Z#dd
l$m%Z%ddl$m&Z&ddl'm(Z(dZ)dZ*dZ+dZ,ej-dddddej-dddddgZ.ej/ddddej/d dd!dej/d"dd#dej/d$dd%d&d'ej/d(e)d)d*d'ej/d+dd,d-d.ej/d/d0d1d2ej-d3dd4d5ej/d6d7d8d5g	Z0ej-d9d:d;d5ej-d<dd=d5ej-d>dd?d5ej-d@ddAd5ej1dBdCdDd5gZ2ej1dEdFdGd5ej1dHdIdJd5ej/dKdLdMd5ej/dNdOdPd5ej/dQdRdSd5ej/dTdUdVd5ej/dWdXdYd5ej/dZd[d\d5ej3d]d^d_d`dadbdcgddd5ej-deddfd5ej-dgddhd5ej/didjdkd5ej/dldjdmd5ej1dnddod5gZ4ej/dpdqdrd5ej/dsdtduej/dvdwdtd5ej/dxdydzd5ej/d{d|d}d5ej/d~dd€d5ej/dd‚dƒd5ej/d„d…d†d5ej/d‡dˆd‰d5ej/dŠdˆd‹d5ej/dŒddŽd5ej/ddd‘d5ej/d’d“d”d5ej/d•d–d—d5ej/d˜d™dšd5ej/d›dœdd5ej1dže+dŸd5ej1d e,d¡d5ej1d¢d£d¤d5ej/d¥d¦d§d5ej1d¨dd«d5ej1d¬dd­d5ej/d®d¯dd°d'ej/d±d²d³d5ej/d´dµd¶d5ej/d·dµd¸d5ej/d¹dµdºd5ej/d»dµd¼d5ej/d½dµd¾d5ej/d¿dÀdÁd5ej/dÂdµdÃd5ej/dÄd“dÅd5ej/dÆdÇdÈd5ej/dÉdÊdËd5ej/dÌdÀdÍd5ej/dÎdÀdÏd5ej/dÐdÑdÒd5ej/dÓdÔdÕd5ej/dÖd×dØd5g'Z5ej6Z6e6j7e5ƒe6j8e0ƒe6j8e2ƒe6j8e4ƒe6j8e.ƒye9ej:dÙƒZ;e6e;gƒWne6ej<dCd…ƒYnXe#j=ej6e6j>j?ƒƒe#j@e6j>j?ƒƒZAedÚdۍZByre6jCj?ƒdkr>eAjDjEe#jFƒnNe6jCj?ƒdÜkr^eAjDjEe#jGƒn.e6jCj?ƒdÝkr~eAjDjEe#jHƒneAjDjEe#jIƒWn&eJk
r´eAjDjEe#j#jIƒYnXddCgdÞddddddddddddddߜ
d:ddµdµej:jKdàƒej:jKdáƒej:jKdâƒdµdµdd:dddµdµdµddddgddd:ddd:dãdãdãdãdddäœ&ZLe
jMƒZNdådæ„ZOdçdè„ZPdãZQdÚZRddlSZSeSjTƒZUejVejWƒƒjXZYdéZZia[dêZ\dëdì„Z]dídî„Z^dïdð„Z_Gdñdò„dòƒZ`Gdódô„dôeaƒZbGdõdö„döebƒZcGd÷dø„døeaƒZdGdùd™„d™eƒZeddûdü„Zfdýdþ„Zgdÿd„ZheidkrehƒdS(ad Trilio Fuse plugin implimentation

    This module is based on the vaultfuse.py module and will eventually
    become the new vaultfuse.py module once integration and refactoring
    of the existing vaultswift.py is complete.

    Currently this module is temporary for the 2.6 release and will be merged
    into a new vaultfuse.py for the next release.
éN)ÚThread)ÚBoundedSemaphore)Úmkstemp)ÚQueueÚEmpty)Úgetpwnam)ÚLRUCache)ÚFUSEÚFuseOSErrorÚ
Operations)Ú*)Úcfg)Úlog)Úutils)Úvaults3)Úfsz%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2édéÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarrzlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated.  Please use logging_context_format_string and logging_default_format_string instead.)rrrzlog-date-formatZDATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)rÚdeprecated_namerzlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)rrz
use-syslogzUse syslog for logging.)rrzsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTzLog output to standard errorZuse_journalz%Enable Systemd native journal supportZuse_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_burstézBurst limitZlog_rotate_intervaléz0Interval, number of hours, of log rate limiting.Zmax_logfile_counté<zNumber of log files to retain.Zlog_rotate_interval_typeZHourszUnits of log rotation intervalZlog_rotation_typeZintervalztype of log retentionZlogging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZlogging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levelszamqplib=WARNzsqlalchemy=WARNz	boto=WARNz	suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Úvault_storage_typeÚs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)rÚvault_data_directory_oldz/var/triliovaultÚtmpfs_mount_pathÚtmpfszLLocation with respect to CONF.vault_data_directory_oldwhere tmpfs is mountedZvault_storage_nfs_exportZlocalz
NFS ExportZvault_storage_nfs_optionsZnolockzNFS OptionsZvault_swift_auth_versionZKEYSTONE_V2z KEYSTONE_V2 KEYSTONE_V3 TEMPAUTHZvault_swift_auth_urlzhttp://localhost:5000/v2.0zKeystone Authorization URLZvault_swift_tenantZadminzSwift tenantZvault_swift_usernamezSwift usernameZvault_swift_passwordZpasswordzSwift passwordZvault_swift_region_nameZ	RegionOnezSwift Region NameZvault_swift_domain_idrzSwift domain idZvault_swift_domain_nameZDefaultzSwift domain nameZvault_swift_container_prefixÚTrilioVaultzSwift Container PrefixZvault_swift_segment_sizeZ33554432zDefault segment size 34MBÚqueue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_countéz(The number of times we retry on failuresZvault_swift_url_templatez,http://localhost:8080/v1/AUTH_%(project_id)szThe URL of the Swift endpointÚvault_segment_sizeé izvault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileÚvault_s3_auth_versionÚDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚz	S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez	S3 RegionÚvault_s3_bucketz	S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚvault_s3_sslÚTruezUse SSLÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionzS3 signature version to useÚvault_s3_support_empty_dirÚFalsez,S3 backend needs empty directory work aroundÚvault_s3_read_timeoutZ120z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolzEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Úvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).ZFLAGé)ÚvalueÚinfoÚwarnz1.0)
Zproject_nameÚregion_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ	tenant_idZservice_typeZ
project_idZ
auth_tokenZproject_domain_nameZ	OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_torÚheaderÚauth_versionÚ
os_optionsZssl_compressionZos_storage_urlZos_usernameZos_passwordZ	os_cacertZos_certZos_keyZos_tenant_nameZos_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclrAZretriesZ	write_aclÚmetarZuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚobject_namecstjˆƒ‡fdd„ƒ}|S)Nc
stˆ||ŽSQRXdS)N)Ú
manifest_lock)ÚargsÚkwargs)Úwrapped©ú!/usr/lib/python3.6/s3vaultfuse.pyÚ_wrap¦szsynchronized.<locals>._wrap)Ú	functoolsÚwraps)rRrUrS)rRrTÚsynchronized¥srXcCstjjƒdkst‚tjdks t‚dtd<tjtd<tjtd<tjtd<tj	td<tj
td	<tjjƒd
krrdtd<nd
td<tjjƒd
kr’dtd<nd
td<tj
r®tj
tdd<tjrÂtjtdd<tjjƒdkrÚd
td<n2tjjtjƒrôtjtd<ntjdtjƒdtd<dS)Nr!r.z1.0rHrJrKZbucketZs3_signatureZs3_read_timeoutÚtrueTZsupport_empty_dirFZs3_sslrIrDrCZfalseZs3_ssl_certzcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connectionr0)ÚCONFr ÚlowerÚAssertionErrorr-Úoptionsr/r1r3r8r;r9r5r4r2r7ÚosÚpathÚexistsÚLOGrBrSrSrSrTÚ
option_config­s4








rbz
%016x.%08xiècstjˆƒ‡fdd„ƒ}|S)Ncs~ytjjtjƒWn$tk
r6tjjtjjƒYnXˆ||Ž}ytjjtjƒWn$tk
rxtjjtjjƒYnX|S)N)ÚloggingÚdisableÚERRORÚ
BaseExceptionZNOTSET)rPrQÚresult)ÚfuncrSrTÚwrapperÝs
z disable_logging.<locals>.wrapper)rVrW)rhrirS)rhrTÚdisable_loggingÜsrjcCsVtjj|ƒ\}}d}x8|dkrL|dkr6tjj||ƒ}n|}tjj|ƒ\}}qW||fS)Nr0ú/)r0rk)r^r_ÚsplitÚjoin)r_ÚheadÚtailÚprefixrSrSrTÚsplit_head_tailìs
rqcCstjj|ƒ\}}|S)N)r^r_rl)r_rnrorSrSrTÚget_headùsrrc@s&eZdZd	dd„Zdd„Zdd„ZdS)
Ú	tmpfsfileFcCs||_||_dS)N)ÚremoveÚpersist_exit)ÚselfrtrurSrSrTÚ__init__ÿsztmpfsfile.__init__cCsLtjjtjtjƒ}t|d\}|_tj|ƒ|j	r>tj	|jƒt
jƒ|jS)N)Údir)r^r_rmrZr#r$rÚ	open_fileÚclosertÚ
tmpfs_semaÚacquire)rvÚtmpfs_mountpathÚfhrSrSrTÚ	__enter__s
ztmpfsfile.__enter__cGs|jstjƒtj|jƒdS)N)rur{Úreleaser^rtry)rvrPrSrSrTÚ__exit__sztmpfsfile.__exit__N)FF)Ú__name__Ú
__module__Ú__qualname__rwrrrSrSrSrTrsþs
	rsc@s€eZdZdd„Zdd„Zdd„Zdd„Zd	d
„Zdd„Zd
d„Z	dd„Z
ddd„Zddd„Zdd„Z
dd„Zdd„Zdd„ZdS) ÚObjectRepositorycKs
||_dS)N)Úroot)rvr†rQrSrSrTrwszObjectRepository.__init__cCs.|jdƒr|dd…}tjjt|ƒ}|j|ƒS)Nrkr)Ú
startswithr^r_rmÚ_SEGMENT_PREFIXÚ
_full_path)rvÚpartialr_rSrSrTÚ_full_segment_paths
z#ObjectRepository._full_segment_pathcCs*|jdƒr|dd…}tjj|j|ƒ}|S)Nrkr)r‡r^r_rmr†)rvrŠr_rSrSrTr‰%s
zObjectRepository._full_pathcCsdS)NrS)rvrNÚflagsrSrSrTÚobject_open+szObjectRepository.object_opencCsdS)NrS)rvrNÚoffÚbufr~rSrSrTÚ
object_upload.szObjectRepository.object_uploadcCsdS)NrS)rvrNÚoffsetr~rSrSrTÚobject_download1sz ObjectRepository.object_downloadcCsdS)NrS)rvrNrSrSrTÚ
object_delete4szObjectRepository.object_deletecCsdS)NrS)rvrNr~rSrSrTÚobject_close7szObjectRepository.object_closeNcCsdS)NrS)rvrNÚlengthr~rSrSrTÚobject_truncate:sz ObjectRepository.object_truncatecCsdS)NrS)rvrNr~rSrSrTÚobject_getattr=szObjectRepository.object_getattrcCsdS)NrS)rvr_r~rSrSrTÚobject_readdir@szObjectRepository.object_readdircCsdS)NrS)rvr_ÚmoderSrSrTÚ
object_accessCszObjectRepository.object_accesscCsdS)NrS)rvr_rSrSrTÚ
object_unlinkFszObjectRepository.object_unlinkcCsdS)NrS)rvr_rSrSrTÚ
object_statfsIszObjectRepository.object_statfs)N)N)r‚rƒr„rwr‹r‰rrr’r“r”r–r—r˜ršr›rœrSrSrSrTr…s

r…csdeZdZ‡fdd„ZGdd„deƒZGdd„dƒZdd„Zd	d
„Zdd„Z	d
d„Z
dd„Zifdd„Zdd„Z
edd„ƒZdd„Zdd„Zedd„ƒZdd„Zdd „Zed!d"„ƒZd#d$„ZdMd&d'„Zd(d)„Zd*d+„Zd,d-„Zd.d/„ZdNd0d1„Zd2d3„Zd4d5„ZdOd7d8„Z d9d:„Z!dPd;d<„Z"d=d>„Z#d?d@„Z$dAdB„Z%dCdD„Z&dEdF„Z'dGdH„Z(dQdIdJ„Z)dKdL„Z*‡Z+S)RÚBackendRepositorycsTtt|ƒj|f|Žttƒj|_ttƒj|_i|_	t
jtƒ|_
i|_i|_i|_dS)N)ÚsuperrrwrÚ	FUSE_USERÚpw_uidrEÚpw_gidÚgroup_idÚmanifestrÚ	S3Backendr]Ú_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ_BackendRepository__worker_poolÚ_BackendRepository__pending_ios)rvr†rQ)Ú	__class__rSrTrwNszBackendRepository.__init__c@s0eZdZdZdd„Zdd„Zdd„Zdd	„Zd
S)zBackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
        cCs8tj|ƒtj|ƒ|_||_tjƒ|_d|_	|j
ƒdS)NT)rrwrr¤Ú_BackendWorker__backendÚ_BackendWorker__job_queueÚ	threadingZEventÚ_stop_eventZdaemonÚstart)rvÚ	job_queuer]rSrSrTrwns

z(BackendRepository.BackendWorker.__init__cCs|jjƒdS)N)r­Úset)rvrSrSrTÚstopxsz$BackendRepository.BackendWorker.stopcCs
|jjƒS)N)r­Zis_set)rvrSrSrTÚstopped{sz'BackendRepository.BackendWorker.stoppedcCs¤tjdtjƒjƒxŠ|jƒsžy<|jjddƒ\}}}z||jf|ž|ŽWd|jj	ƒXWqt
k
rpwYqtk
rš}ztj|ƒWYdd}~XqXqWdS)zO Start up the worker and block until there is an item in the queue
            zStarting worker thread[%x].TrN)
rarAr¬Úcurrent_threadÚidentr²r«ÚgetrªZ	task_donerÚ	ExceptionÚ	exception)rvrhrPÚkargsÚerSrSrTÚrun~s
z#BackendRepository.BackendWorker.runN)r‚rƒr„Ú__doc__rwr±r²rºrSrSrSrTÚ
BackendWorkerjs

r¼c@s8eZdZdZdd„Zdd„Zdd„Zdd	„Zd
d„ZdS)
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
        cCs>ttjƒ|_g|_x&t|ƒD]}|jjtj|j|ƒƒqWdS)N)	rrZr'r¯ÚworkersÚrangeÚappendrr¼)rvZnum_threadsr]Ú_rSrSrTrw—s
z,BackendRepository.BackendWorkerPool.__init__cCs4x|jD]}|jƒqWx|jD]}|jƒq WdS)N)r½r±rm)rvÚtrSrSrTÚ__del__Ÿsz+BackendRepository.BackendWorkerPool.__del__cOs|jj|||fƒdS)z+ Add a job to the worker queue
            N)r¯Zput)rvrhrPr¸rSrSrTÚadd_job¦sz+BackendRepository.BackendWorkerPool.add_jobcCsx|D]}|j||ƒqWdS)z4 Add a list of jobs to the worker queue
            N)rÃ)rvrhZ	args_listrPrSrSrTÚmap«s
z'BackendRepository.BackendWorkerPool.mapcCs|jjƒdS)z> Wait for completion of all the jobs in the queue
            N)r¯rm)rvrSrSrTÚwait_completion±sz3BackendRepository.BackendWorkerPool.wait_completionN)	r‚rƒr„r»rwrÂrÃrÄrÅrSrSrSrTÚBackendWorkerPool“srÆcCsVtjj|ƒ\}}d}x8|dkrL|dkr6tjj||ƒ}n|}tjj|ƒ\}}qW||fS)Nr0rk)r0rk)r^r_rlrm)rvr_rnrorprSrSrTrq¶s
z!BackendRepository.split_head_tailcCstjj|ƒ\}}|S)N)r^r_rl)rvr_rnrorSrSrTÚ	_get_headÂszBackendRepository._get_headcCs.|jdƒr|dd…}tjjt|ƒ}|j|ƒS)Nrkr)r‡r^r_rmrˆÚ
_get_cache)rvrŠr_rSrSrTÚ_get_segment_cacheÆs
z$BackendRepository._get_segment_cachecCs*|jdƒr|dd…}tjj|j|ƒ}|S)Nrkr)r‡r^r_rmr†)rvrŠr_rSrSrTrÈÌs
zBackendRepository._get_cachecCs>|j|ƒ\}}i}i}tjƒ}||d<t|ƒ}|jj|ƒ}|S)NrN)rqr]ÚcopyÚbunchifyr¥Zget_object_manifest)rvrNÚ	containerrpÚput_headersÚmrÚ_optsr£rSrSrTÚ_read_object_manifestÒsz'BackendRepository._read_object_manifestcCsl|j|ƒ\}}i}i}d|d<tjƒ}||d<x |jƒD]\}	}
|
|d|	<q8Wt|ƒ}|jj|||ƒdS)NrYzx-static-large-objectrNzx-object-meta-)rqr]rÊÚitemsrËr¥Zupload_object_manifest)rvrNÚobject_manifestÚmetadatarÌrprÍrÎrÏrKr@rSrSrTÚ_write_object_manifestæs
z(BackendRepository._write_object_manifestcCsÈ|j|ƒ\}}tjƒ}|dkr$g}n|g}d|d<d|d<d|d<d|d<d|d<t|ƒ}i}|dkrz||d<|j|ƒnd}|jj||ƒ}i}x2|djƒD]"\}	}
d	|	krž|
||	jd
ƒd<qžW|S)Nr0Ú	delimiterFÚhumanÚtotalsÚlongrpÚheadersz
x-object-metazx-object-meta-r)	rqr]rÊrËr¿r¥Ústat_objectrÑrl)rvrNrÌrprÏrPrÚstrÓrKr@rSrSrTÚ_get_object_metadataÿs,z&BackendRepository._get_object_metadatacICs~|j|ƒ\}}|j|ƒ}|jj|tjƒƒ|j|<|tjkpX|tddƒtddƒtddƒfk}|j|Z||j	kr¼dii|j	|<|tjksæ|tddƒtddƒtddƒfksæ|tddƒtddƒfksæ|tddƒtd	dƒtd
dƒfkr0y|j
|ƒ}WnFtk
r:}z(tj
d|ƒtjdƒ|j
|ƒ}WYdd}~XnXxJ|D]B}	|	d
jdƒdjdƒd}
t|
dƒ}d|	d<|	|j	||<qBW|j|ƒ}|d|j	|d<y"|j|j	|dƒ}
tj|
ƒWntk
rÜYnXtjjtjj|ƒƒstjtjj|ƒƒt|dƒ}|jtj|ƒƒWdQRXnŒtjjtjj|ƒƒsXtjtjj|ƒƒ|tddƒtddƒtddƒfks†|tjkrÞy|j|ƒWntk
rªYnXyt|dƒ}WdQRXWntk
rÜYnXy|j|dƒ}
tj|
ƒWntk
rYnXtj||ƒ}z:|jtj t!ƒ|j"|<ddi|j	|d|<|j#||ƒWd|j"j$|dƒ|j	|dj$|dƒtj%|ƒXyt|dƒ}WdQRXWntk
rºYnXWdQRXtj||ƒ}y:d|i|j	|d|<|jtj t!ƒ|j"|<t&ƒ|j'|<|Stk
rx}zNtj(|ƒ|j"j$|dƒ|j	|dj$|dƒ|j'j$|dƒtj%|ƒ‚WYdd}~XnXdS)NZ8000éZ8800Zc000Úopen_handlesZ8401Z8402Z8002Z8802Zc002z+Manifest for %s not found. Trying in 5 secsrÚnamez
-segments/rÚ.rFÚmodifiedzsegments-dirÚwZ8001Z8801Z0001z	-segmentsÚreadonly))rqr‰r¦rµr¬ÚRLockr^ÚO_RDONLYÚintr£rÐr¶rarAÚtimeÚsleeprlrÜÚmakedirsrfr_r`ÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_RDWRr›r‹rÆrZr(r]r§Ú
_object_closeÚpoprzr°r¨r·)rvrNrŒrÌrpÚ	full_pathrãr£ÚexÚsegZoffstrr‘rÓZsegment_dirÚfr~rSrSrTr:s®

 
 "


 


zBackendRepository.object_opencCsxyFg}x |D]}|jtjj||ƒƒqWtjƒ}t|ƒ}|j||ƒWn,tk
rr}zt	j
|ƒWYdd}~XnXdS)a4 Utility method to be dispatched to a worker thread in order to clean up old segments.

        Args:
            backend (class instance): Instance of the backend plugin.
            container (str): Container name, a.k.a root directory.
            segment_list (list): List of segments to remove.
        N)r¿r^r_rmr]rÊrËÚdelete_object_listr¶rar·)rvÚbackendrÌÚsegment_listZdelete_listÚobjrÏrórSrSrTZ__purge_old_segments_task½s
z+BackendRepository.__purge_old_segments_taskcCsž|j|jƒ|j|zyB|j|jddt|dƒ}|j|ƒ\}}g}i}d}|j|d|ds^d}	d}
d}x |	|j|krPy|j|j||	d|ƒ}Wn0tj	dƒ|j|j||	d|ƒ}YnX|j||	d	r2t
|ƒ}
t|
jt
jƒ}|j|j||	d|
j||
jd
œƒnP|j||	d}|j|j||	d|j||	d||j||	d
d
œƒ|	t
j7}	|d7}|
|7}
q€W|j|||t|ƒt|
ƒdœdd}	x˜dr\|r\|j|||	ƒ}t|ƒdkrðPt|ƒ}|j|j||	dƒ\}}tt|ƒt|gƒƒ}t|ƒdkrN|j|j|j||ƒ|	t
j7}	qÆWdStk
rŽ}ztj|ƒWYdd}~XnXWdQRXdS)zé Handle object_close by updating the manifest.

         Waits for all of the background jobs to complete prior to updating
         manifest using the main thread. Also queues up tasks to clean up
         any old segments.
        zsegments-dirrkz	-segmentsrrÞrãrßrrá)r_ÚetagÚ
size_bytesÚcontent_typerûÚhashrür)zsegments-dirz
segment-countz
total-size)rÓTN)r§rÅr¦r£rµrˆrqr—rçrèrËÚminÚst_sizerZr*r¿rúrürÔÚstrrøÚlenÚsortedÚlistr°rÃÚ+_BackendRepository__purge_old_segments_taskr¶rar·)rvrNr~Úsegments_dirrÌrprÒZ
segments_listZsegmentsr‘Z
total_sizeÚsegment_sizerÛÚstatZobjectsÚcÚpZ
purge_listrórSrSrTrðÐs”




zBackendRepository._object_closecCsÚ|j||ƒ|jj|ƒ|jj|ƒ|j|dj|ƒytj|ƒWntk
rZYnX|j|Rt	|j|dƒdkr´ytj
|j|ƒƒWntk
r¦YnX|jj|ƒWdQRX||jkrÖ|jj|dƒdS)NrÞr)rðr§rñr¨r£r^rzrfr¦rrtr‰)rvrNr~rSrSrTr”Js"
zBackendRepository.object_closec#Csž|j|ˆy*||j|krJ|j||ddkrJ|j||d}n8|j||ƒ}|j|jddt|dƒ}tjj||ƒ}tj	ƒ}d|j|k|d<|j
|ƒ\}	}
tdd	2}t|d
ƒ}|j
|ƒWdQRXt|ƒ|d<WdQRX|
jdƒ|d<t|ƒ}|	|g}
|j|j|ƒ|j|j|j|
|||||ƒWnTtk
rŽ}z6tj|ƒ||j|kslt‚|j|j|ƒ‚WYdd}~XnXWdQRXdS)
NráTrßzsegments-dirrkz	-segmentsÚ0Z
path_valid)ruÚwbrrN)r¦r£Ú,_BackendRepository__next_segname_from_offsetrµrˆr^r_rmr]rÊrqrsrërìrÚrstriprËr¨Úaddr§rÃÚ&_BackendRepository__object_upload_taskr¶rar·r\rt)rvrNr‘rr~Úseg_fullnameZsegnamerrÏrÌrùÚtempfsrõÚargs1rórSrSrTr`s:

zBackendRepository.object_uploadc	*CsXtjd||tjƒjfƒ|j|||j|ks8t‚WdQRXz|y|j||ƒWnft	k
rº}zJtj
|ƒ|j|(||j|ksŽt‚|j|j|ƒWdQRX‚WYdd}~XnXWdtj
ƒtj|dƒX|j|l||j|kri|j||<||j||d<d|j||d<||j|ks:t‚|j|j|ƒWdQRXdS)zP Method run by a worker in the thread pool to upload an object segment.
        z6Object [%s] segment [%s] upload running in thread[%x].NrrßTrá)rarAr¬r³r´r¦r¨r\Z
upload_objectr¶r·rtr{r€r^r£)	rvr÷rrÏrNr‘rr~rórSrSrTZ__object_upload_task‰s,
z&BackendRepository.__object_upload_taskc
CsHxvtjdƒ|j|X||j|kr(w||j|krVtd|tt|ƒtdƒfƒ‚|j||d}PWdQRXqW|j|j	dƒƒ\}}t
dd¨}tjƒ}d|d<d|d	<|j	dƒ|d
<t
|ƒ}||g}	y:|jj|	|ƒt|j	dƒdƒ}
|
jƒ}WdQRXt|ƒStk
r8}ztj|ƒ‚WYdd}~XnXWdQRXdS)Ngš™™™™™¹?zobject %s not foundrrßrkT)rtrpZ
out_directoryZout_fileÚrb)rçrèr¦r¨r£r¶ÚSEGMENT_FORMATrærqr
rsr]rÊrËr¥Zdownload_objectrëÚreadÚ	bytearrayrar·)
rvrNr‘r~rrÌrùrrÏrrõrrórSrSrTr’ªs6

z!BackendRepository.object_downloadcCs˜|j|„|j|ƒ\}}tjƒ}t|ƒ}|g}|dkrJ|dkrJ|j|ƒy|jj||ƒWn,tk
rˆ}zt	j
|ƒWYdd}~XnXWdQRXdS)Nr0rk)r¦rqr]rÊrËr¿r¥Ú
delete_objectr¶rar·)rvrNrÌrùrÏrrórSrSrTr“Ìs

zBackendRepository.object_deleteNcCs&|rdS|j|tjƒ}|j||ƒdS)N)rr^ÚO_WRONLYr”)rvrNr•r~rSrSrTr–Üsz!BackendRepository.object_truncatecCsptjƒ}d|d<d|d<d|d<d|d<tjj|dt|ƒƒ|d<g}|dkrTg}n|g}t|ƒ}|jj||ƒS)	NrÕFrÖr×rØz%016xrpr0)	r]rÊr^r_rmrærËr¥Z
list_segments)rvrÌrr‘rÏrPrSrSrTrøâszBackendRepository.segment_listc	CsÀ|j|ƒ\}}|j|jddƒ}|rT|jdtƒr@|j|ƒ\}}|j|ƒ\}}|}n|d}|j|||ƒ}t|ƒdkrŠtt|ƒtdƒfStt|ƒtt	|ƒdj
|ƒdj
dƒddƒdfS)	Nzsegments-dirrkz	-segmentsrrràrÝéÿÿÿÿ)rqr£rµr‡rˆrørrrærrl)	rvr_r‘rÌrprrr	ÚfilesrSrSrTZ__next_segname_from_offsetôs$z,BackendRepository.__next_segname_from_offsetc
Csò|j||j|ƒ\}}|jj|dƒrV||j|krV|j||d}|jdƒdS|j|jddƒ}|r€|j|ƒ\}}|}n|d}|j|||ƒ}	WdQRXt|	ƒdkrÀtt|ƒtdƒfStt|ƒtt	|	ƒd	j|ƒdjdƒddƒfS)
Nrßz
-segments/rzsegments-dirz	-segmentsrràrÝr)
r¦rqr£rµrlrørrrær)
rvr_r‘rÌrprôrrr	rrSrSrTÚcurr_segname_from_offset	s z*BackendRepository.curr_segname_from_offsetcs‚tjj|ƒr~y@tj|ƒ‰t‡fdd„dDƒƒ}d|d<t|d	dƒ|d
<|Stk
rx}ztj|ƒWYdd}~XnXdSdS)aÆ Utility to check the tmpfs cache and return stat() from that.

         This method looks to see if the object (directory) exists in the
         local cache and will perform a stat() locally instead of calling
         all the way to the backend.

        Args:
            object_cache_path (str): Cache path to the object we need stat infor on.

        Returns:
            Dictionary of stat() information or None if object does not exist.
        c3s|]}|tˆ|ƒfVqdS)N)Úgetattr)Ú.0rK)rÛrSrTú	<genexpr>4sz0BackendRepository._stat_cache.<locals>.<genexpr>Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkrÿÚst_uidiÚ
st_blksizeÚ	st_blocksN)rr r!r"r#r$rÿr%)	r^r_ÚisdirÚlstatÚdictrær¶rar·)rvZobject_cache_pathÚ	stat_infor¹rS)rÛrTÚ_stat_cache"s(



zBackendRepository._stat_cachec
$sR|j|ƒ}|j|ƒ}|dk	r |S|j|ƒ\}}tjƒ}|dkrDg}n|g}d|d<d|d<d|d<d|d<d|d<t|ƒ}i}|dkrš||d<|j|ƒnd}yN|jj||ƒ‰|j	|d<|j
|d	<ˆd
jddƒ|d<ˆd
jd
dƒ|d<tˆdƒ|d<tˆdƒ|d<tˆdƒ|d<d|d<d|d<|dk	rHd|krHd|d<tˆdƒ|d<|ddkrp|dks®|ddkrˆ|dks®|ddkr |dks®ˆddkrêd|d<d|d<d |d<|j
|ƒ}	tjj|	ƒsêtj|	d!ƒWnBtk
r0}
z"|dkr|}|j
tjj||ƒƒ}|j|ƒ}ytj|ƒ‰Wnžtk
rÜ|}t|ƒdkrj|jƒyVtjj|ddƒ|d<|jj||ƒ‰tˆƒdkr´tjtjj|ƒd!ƒn
tj|ƒWntk
rÖYnXYnX|d"ksü|dd)…jd#ƒrdStj|ƒ‰t‡fd$d%„d*Dƒƒ}WYdd}
~
XnXd&|d'<t|dd&ƒ|d(<|S)+Nr0rÕFrÖr×rØrpr!r%rÙZETagrúZContentTyperüZ	timestamprr r#rr$iír"Zauthorized_keyi€ÚsizerÿrZ	directoryTéiiýAiéZ4913ú~c3s|]}|tˆ|ƒfVqdS)N)r)rrK)rÛrSrTršsz3BackendRepository.object_getattr.<locals>.<genexpr>ir&r'r)rr r!r"r#r$rÿr%)r‰r,rqr]rÊrËr¿r¥rÚr¢rErµrærÈr^r_r`Úmkdirr¶rmrÇr)rfrrñÚlist_objectsrêrarAÚendswithr*)
rvrNr~ròrrÌrprÏrPZcontainer_pathróÚmkdirsrrS)rÛrTr—Ksž








z BackendRepository.object_getattrccsLg}|j|ƒ\}}tjƒ}d|d<d|d<d|d<d|d<d|d<g}|dkrTg}n"|g}|dkrv|dk	rv|d|d<g}t|ƒ}||jj||ƒ7}x˜|D]}	|j|	ƒ\}
}|
dks¼|dkrøtjj||j	|	ƒƒ}ytj
|d	d
Wntk
röYnX|
dk	rš|
dkršd|
kršd|
krš|
|krš|j|
ƒqšWxt
|ƒD]}
|
Vq8WdS)
NrÕFrÖr×rØrpr0rkié)r™z	-segmentsZ	_segments)rqr]rÊrËr¥r1r^r_rmrÇrérfr¿r)rvrNr~ZlistingrÌrprÏrPÚdirentsZlstZ	componentÚrestr3ÚrrSrSrTr˜®sB
z BackendRepository.object_readdircCsdS)NrS)rvrNr™rSrSrTršÝszBackendRepository.object_accessFcCsN|td<tjƒ}t|ƒ}|sØyŽ|j|ƒ}|j|ƒ}g}x|D]}|j|dƒq<W|jj||ƒ|jdƒ}|dk	r¨|g}	|jj	|	|ƒyt
j|j|ƒƒWnYnXWn,t
k
rÖ}
ztj|
ƒWYdd}
~
XnX|j|ƒ\}}|g}
|dkoú|dkr|
j|ƒy|jj|
|ƒWn.t
k
rH}
ztj|
ƒWYdd}
~
XnXdS)NrMrßzsegments-dirr0rk)r]rÊrËrÐrÜr¿r¥rörµÚrmdir_objectr^ÚrmdirrÈr¶rar·rqr)rvrNrMrÏZobj_manifestZobj_metadatarøÚmanrrPrórÌrùrrSrSrTr›às>







zBackendRepository.object_unlinkc	CsÐtjƒ}t|ƒ}g}y|jj||ƒ}Wn6tk
r\}ztj|ƒtt	j
ƒ‚WYdd}~XnXd|dkrt|dƒ}t|dƒt|dƒ}nd}t|dƒ}i}||d<||d<||d<d	|d
<d	|d<|S)
Nzx-account-meta-quota-bytesrÙzx-account-bytes-usedrr-Úf_blocksÚf_bfreeÚf_bavailrÚf_favailÚf_frsizer)r]rÊrËr¥rÚr¶rar·r
ÚerrnoÚENOENTræ)	rvrNrÏrZstvrór:r<ZdtrSrSrTrœs*
zBackendRepository.object_statfsc
CsÚtjd|ƒ|j|ƒ\}}tjƒ}t|ƒ}||g}y|jj||ƒWn*tk
rp}ztj	|ƒdSd}~XnX|j
|ƒ}	|dkr˜|j
tjj
||ƒƒ}	ytj|	|ƒWn,tk
rÔ}ztj	|ƒWYdd}~XnXdS)Nz	mkdir, %srF)rarrqr]rÊrËr¥Zmkdir_objectr¶r·rÈr^r_rmré)
rvr_r™ZistrÌrùrÏrPróÚ
cache_pathrSrSrTr0"s$

zBackendRepository.mkdirc
:CsÖ|j|ƒ\}}tjƒ}d|d<t|ƒ}|g}|dkrF|dkrF|j|ƒg}y||jj||dd7}Wn,tk
r}ztj	|ƒWYdd}~XnXt
|ƒdkr¨ttj
ƒ‚y|jj||ƒWn,tk
ræ}ztj	|ƒWYdd}~XnX|jdtƒy||jj||dd7}Wn.tk
r<}ztj	|ƒWYdd}~XnXt
|ƒdkrŽy|jj||ƒWn.tk
rŒ}ztj	|ƒWYdd}~XnX|j|ƒ}tjj|ƒr°tj|ƒ|j|ƒ}	tjj|	ƒrÒtj|	ƒSdS)Nrpr0rkr))Z	max_itemsr)rqr]rÊrËr¿r¥r1r¶rar·rr
r?Z	ENOTEMPTYr7ÚinsertrˆrÉr^r_r(r8rÈ)
rvr_rÌrùrÏrZ	dir_itemsróZsegment_cache_pathrArSrSrTr8BsH






zBackendRepository.rmdircCsVtjd|ƒy.|j|ƒ\}}|jtjj||ƒƒ}tj||ƒStk
rPYnXdS)Nz	chmod, %s)	rarrqrÈr^r_rmÚchmodrf)rvr_r™rÌrprArSrSrTrCqszBackendRepository.chmodcCsXtjd|ƒy0|j|ƒ\}}|jtjj||ƒƒ}tj|||ƒStk
rRYnXdS)Nz	chown, %s)	rarrqrÈr^r_rmÚchownrf)rvr_ÚuidÚgidrÌrprArSrSrTrDzszBackendRepository.chowncCstdƒ‚dS)NzNot Applicable)r¶)rvrßÚtargetrSrSrTÚsymlinkƒszBackendRepository.symlinkc
[Cs&|jj|dƒdkst‚|jj|dƒrHtjdƒ|jj|dƒrHtd|ƒ‚tjd||fƒ|d}y|j|ddWn,tk
r }ztj	|ƒWYdd}~XnXyJ|j
|ƒ}|j
|ƒ}|jd|dƒ|jd|dƒkrê|j|ddd	SWn$tk
r}zWYdd}~XnXd
}y®y|j
|ƒ}Wn$tk
rJ}zWYdd}~XnxX|j|ƒ}|jd|dƒ}	g}
x2|D]*}|
j|d|d|d
|ddœƒqpW|j
||
|	|d|ddœdd}Wn0tk
rô}ztj	|ƒ‚WYdd}~XnXzàyÂ|j|ƒ}|j
|ƒ}|jd|dƒ}	g}x2|D]*}|j|d|d|d
|ddœƒq(W|j
|||	|d|ddœdy|j|ddWn.tk
r¶}ztj	|ƒWYdd}~XnXWntk
rÒ‚YnXWd|r y|j|d
dWn.tk
r}ztj	|ƒWYdd}~XnXXd	S)Nrz%s in use. Try againzrename, %s -> %sr/T)rMzsegments-dirz	-segmentsrFrßrýrûrü)r_rúrûrüz
segment-countz
total-size)zsegments-dirz
segment-countz
total-size)rÓ)r£rµr\rçrèr¶rarr›r·rÜrÐr¿rÔrf)
rvÚoldÚnewZnewbak_nameróZnew_metadataZold_metadataZnewfile_existsZnew_manifestrZnewbak_manifestr9Zold_manifestrSrSrTÚrename†s










 zBackendRepository.renamecCsZtjd|ƒt|ƒ\}}|jtjj||ƒƒ}t|ƒ\}}|jtjj||ƒƒ}tj||ƒS)Nzlink, %s)rarrqrÈr^r_rmÚlink)rvrGrßrÌrpZcache_path_targetZcache_path_namerSrSrTrL÷szBackendRepository.linkcCsNtjd|ƒt|ƒ\}}|j|ƒ}ytj||ƒWntk
rHdSXdS)Nzutimens, %sr)rarrqrÈr^Úutimerf)rvr_ÚtimesrÌrprArSrSrTÚutimensÿs
zBackendRepository.utimenscCsXy>tjjtjtjƒ}tjj|ƒr<tjj|ƒr<tj	|dddWnt
k
rRYnXdS)Né)Ztimeoutr)r^r_rmrZr#r$r(ÚismountrÚumountrf)rvr_r}rSrSrTÚdestroys
zBackendRepository.destroy)N)N)F)F)N),r‚rƒr„rwrr¼rÆrqrÇrÉrÈrÐrÔrÜrXrrrðr”rrrjr’r“r–rørrr,r—r˜ršr›rœr0r8rCrDrHrKrLrOrSÚ
__classcell__rSrS)r©rTrMsL)#;z)!"
)
c/
#
 /		q
rc@speZdZdd„Zdd„Zddd„Zdd	„Zddd„Zd
d„Zdd„Z	dd„Z
dd„Zdd„Zdd„Z
dd„Zd
S)Ú	FuseCachecCsb||_||_t|_ttƒj|_ttƒj|_t	j
j|jƒs†y4tj
|jƒtj|jt|jƒdt|jƒgƒWqÎtk
r‚‚YqÎXnHt	j|jƒ}|j|jksª|j|jkrÎtjtjt|jƒdt|jƒgƒyvt	j
jtjtjƒ}t	j
j|ƒsøtj|ƒt	j
j|ƒsBdttjƒttjƒ}dd|d}tjdd|d|gƒWntk
r\‚YnXdS)Nú:r?zsize=%dM,mode=0777r)ir%z-o)r†Ú
repositoryÚlrucacherrŸr rEr¡r¢r^r_r(rr0rDrrfrr%r!rZr#rmr$rZensure_treerQrær*r,Zmount)rvr†rWr+r}Z
tmpfs_sizeZtmpfs_buffer_cfgrSrSrTrw-s6(
$

zFuseCache.__init__cCsL|jj||ƒ}|jj|dƒr(|jj|ƒttjdtj	ƒ|t
dœ|j|<|S)N)Úmaxsize)rXÚlrulockrNÚwrites_before_update_manifest)rWrrXrµrñrrZr,r¬ÚLockÚNUMBER_UPLOADS_BEFORE_FLUSH)rvrNrŒr~rSrSrTrRs
zFuseCache.object_openTcCs®tjd|tjƒjfƒ|j|}|d|ks2t‚|d}|dPy4x.|jƒ\}}|drH|jj	|||d|ƒqHWWnt
k
rŒYnXWdQRX|rª|jj||ƒdS)NzCache object_flush [%s] [%x]rNrXrZráÚdata)rarr¬r³r´rXr\ÚpopitemrWrÚKeyErrorrð)rvrNr~Úupdate_manifestÚitemÚcacherŽrSrSrTÚobject_flush_s"

zFuseCache.object_flushcCsFtjd|tjƒjfƒ|j||dd|jj||ƒ|jj	|ƒdS)NzCache object_close [%s] [%x]F)ra)
rarr¬r³r´rdrWr”rXrñ)rvrNr~rSrSrTr”vszFuseCache.object_closeNcCs|jj|||ƒdS)N)rWr–)rvrNr•r~rSrSrTr–€szFuseCache.object_truncateccsVxP|dkrP|tjtj}||}t|tj|ƒ}|||fV||7}||8}qWdS)Nr)rZr*rþ)rvr‘r•Z
seg_offsetÚbaseÚseg_lenrSrSrTÚ_walk_segmentsƒs
zFuseCache._walk_segmentsc!CsŽ|j|d|kst‚tƒ}|j|dTxJ|j||ƒD]8\}}}y|j|d|d}	Wnütk
rby¸|j|d}
t|
ƒtjkr|
jƒ\}}|dr|j	j
|||d|ƒ|j|dd8<|j|ds|j	j||ƒt|j|d<|j	j
|||ƒ}	d|	d	œ|j|d|<Wn,tk
r\}
ztj|
ƒd
Sd}
~
XnXYnX||	|||…7}q>WWdQRXt|ƒS)NrNrZrXr^rár[rF)rár^r)rXr\rrgrfrrZr,r_rWrrðr]r’r¶rar·Úbytes)rvrNr•r‘r~Z
output_bufÚ	segoffsetrerfÚsegdatarcrŽrbrórSrSrTÚobject_readŽs@


"zFuseCache.object_readcCsÖtjd|tjƒjfƒt|ƒ}|j|d|ks6t‚d}|j|d~xt|j||ƒD]b\}}}	|j|d}
||
kr\t|
ƒt	j
krø|
jƒ\}}|drø|jj
|||d|ƒ|j|dd	8<|j|dsø|jj||ƒt|j|d<y4|jj|||ƒ}
|
dkrtd
ƒ‚d|
dœ|
|<Wn,tk
rXtd	ƒ}
d
|
dœ|
|<YnXn|
|d}
t|
ƒ|kr|
jd||	t|
ƒƒ||||	…|
|||	…<d
|
|d<||	7}q\WWdQRXt|ƒS)NzCache object_write [%s] [%x]rNrrZrXrár^r[rzObject not foundF)rár^Tó)rarr¬r³r´rrXr\rgrZr,r_rWrrðr]r’r¶rfrÚextend)rvrNrr‘r~r•ZbufptrrirerfrcrŽrbrjrSrSrTÚobject_writeÇsN


zFuseCache.object_writecCstj|jj|ƒ|ƒS)N)r^r0rWr‰)rvr_r™rSrSrTr0szFuseCache.mkdircCs|jj|ƒ}tj|ƒS)N)rWr‰r^r8)rvr_ròrSrSrTr8szFuseCache.rmdircCs|jj|ƒ}tj||ƒS)N)rWr‰r^rC)rvr_r™ròrSrSrTrC"szFuseCache.chmodcCs|jj|ƒ}tj|||ƒS)N)rWr‰r^rD)rvr_rErFròrSrSrTrD&szFuseCache.chown)T)N)r‚rƒr„rwrrdr”r–rgrkrnr0r8rCrDrSrSrSrTrU,s%


9TrUc@sÚeZdZd2dd„Zdd„Zdd„Zdd	„Zed3d
d„ƒZdd
„Z	dd„Z
dd„Zdd„Zdd„Z
dd„Zdd„Zdd„Zdd„Zdd„Zd4d d!„Zd"d#„Zd5d$d%„Zd&d'„Zd(d)„Zd6d*d+„Zd,d-„Zd.d/„Zd0d1„ZdS)7r&NcCs&||_|pt|ƒ|_t||jƒ|_dS)N)r†rrWrUrc)rvr†rWrSrSrTrw+szTrilioVault.__init__cCs|jj||ƒdS)N)rWrš)rvr_r™rSrSrTÚaccess3szTrilioVault.accesscCs|jj||ƒS)N)rWrC)rvr_r™rSrSrTrC6szTrilioVault.chmodcCs|jj|||ƒS)N)rWrD)rvr_rErFrSrSrTrD9szTrilioVault.chowncCs|jj||ƒS)N)rWr—)rvr_r~rSrSrTr<szTrilioVault.getattrccs4ddg}|j|jj||ƒƒx|D]
}|Vq"WdS)Nràz..)rmrWr˜)rvr_r~r4r6rSrSrTÚreaddir@s
zTrilioVault.readdircCs2tj|j|ƒƒ}|jdƒr*tjj||jƒS|SdS)Nrk)r^Úreadlinkr‰r‡r_Úrelpathr†)rvr_ÚpathnamerSrSrTrqFs
zTrilioVault.readlinkcCstj|jj|ƒ||ƒS)N)r^ÚmknodrWr‰)rvr_r™ZdevrSrSrTrtXszTrilioVault.mknodcCs|jj|ƒS)N)rWr8)rvr_rSrSrTr8[szTrilioVault.rmdircCs|jj||ƒS)N)rWr0)rvr_r™rSrSrTr0^szTrilioVault.mkdircCs|jj|ƒS)N)rWrœ)rvr_rSrSrTÚstatfsaszTrilioVault.statfscCs|jj|ƒS)N)rWr›)rvr_rSrSrTÚunlinkdszTrilioVault.unlinkcCs|jj||ƒS)N)rWrH)rvrßrGrSrSrTrHgszTrilioVault.symlinkcCs|jj||ƒS)N)rWrK)rvrIrJrSrSrTrKjszTrilioVault.renamecCs|jj||ƒS)N)rWrL)rvrGrßrSrSrTrLmszTrilioVault.linkcCs|jj||ƒS)N)rWrO)rvr_rNrSrSrTrOpszTrilioVault.utimenscCs|jj||ƒS)N)rcr)rvr_r™rSrSrTrëvszTrilioVault.opencCs|j|tjƒS)N)rër^ÚO_CREAT)rvr_r™ZfirSrSrTÚcreateyszTrilioVault.createcCs|jj||||ƒ}|S)N)rcrk)rvr_r•r‘r~rrSrSrTr|szTrilioVault.readcCs|jj||||ƒS)N)rcrn)rvr_rr‘r~rSrSrTrì€szTrilioVault.writecCs|jj|||ddS)N)r~)rcr–)rvr_r•r~rSrSrTÚtruncateƒszTrilioVault.truncatecCs|jj||ƒdS)N)rcrd)rvr_r~rSrSrTÚflush†szTrilioVault.flushcCs|jj||ƒdS)N)rcr”)rvr_r~rSrSrTr€‰szTrilioVault.releasecCstjd|ƒ|jj|ƒS)Nzdestroy, %s)rarrWrS)rvr_rSrSrTrSszTrilioVault.destroy)N)N)N)N)N)r‚rƒr„rwrorCrDrjrrprqrtr8r0rurvrHrKrLrOrërxrrìryrzr€rSrSrSrSrTr&*s2



ú/etc/fuse.confcCsÐd}tjj|ƒrJt|dƒ*}x"|D]}d|kr"d|kr"d}Pq"WWdQRX|dkrÌd}tjj|ƒrˆt|dƒ}|jƒdd}WdQRXtd	d
ƒ}|j|ƒWdQRXtjd	|ƒtjd	ƒtj	ddgƒdS)
Nrr6Zuser_allow_otherú#rzuser_allow_other 
ZrtÚ
z/tmp/fuse.conf.tmpZwtz/etc/fuse.confz	root:root)
r^r_r`rërrìrrÊrtrD)Z	conf_fileÚfoundrõÚlineÚsZoutfrSrSrTÚ	fuse_conf•s"

rcCs yšytj|dgƒWntk
r(YnXtjj|ƒrPtj|dtdtgƒnHtj	|dgƒtj	|dgƒtj|tdtgƒtj|tdtgƒWn,t
k
rÆ}ztj|ƒWYdd}~XnXdd„tj
tjƒDƒt|t|ƒd}d}tjjƒd	krd
}t|||ddddddS)Nz-lz-RrVz-pcSs&g|]}tjtjjtj|ƒdd‘qS)T)Ú
ignore_errors)ÚshutilZrmtreer^r_rmrZr#)rÚxrSrSrTú
<listcomp>¼szmain.<locals>.<listcomp>)rWTrYF)Z	nothreadsZ
foregroundZnonemptyZ
big_writesZallow_other)rrRrfr^r_r(rDrŸÚ
FUSE_GROUPr0r¶rar·ÚlistdirrZr#r&rr<r[r	)Z
mountpointZ	cacherootróZtvaultpluginZdisable_fuse_threadsrSrSrTÚmain¨s8rˆcCs.tƒtjtjkst‚tƒttjtjƒdS)z$Main routine that drives fuse mount.N)	rbrZr'r(r\rrˆr"r#rSrSrSrTrºÔsrºÚ__main__i€i)r{)jr»r^ZgrpÚsysr?rçrírƒrVÚ
subprocessr¬rrZtempfilerrrÚImportErrorZqueueÚpwdrZ
cachetoolsrZfuser	r
rZfusepyZs3fuse.bunch_p3ZastZoslo_configr
Zoslo.configZoslo_logrrcZs3fuserrZs3fuse.privseprZ_DEFAULT_LOG_DATE_FORMATrˆZQUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZcontego_vault_optsrZZ
register_optsZregister_cli_optsrÚenvironÚflagÚargvZsetupr r[Z	getLoggerrar{r=ZloggerZsetLevelÚDEBUGÚINFOZWARNrerfrµr]r\rOrXrbZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetpassZgetuserrŸZgetgrgidÚgetgidZgr_namer†rrXr]rjrqrrrsÚobjectr…rrUr&rrˆrºr‚rSrSrSrTÚ<module>sÄ



















#
4hk,


Products

About

Resources

Contact Gemfury