Why Gemfury?
Push, build, and install
RubyGems
npm packages
Python packages
Maven artifacts
PHP packages
Go Modules
Debian packages
RPM packages
NuGet packages
Repository URL to install this package:
|
Version:
4.1.94.1.dev5-4.1 ▾
|
python3-s3fuse-plugin
/
usr
/
lib
/
python3.6
/
site-packages
/
s3fuse
/
__pycache__
/
s3vaultfuse.cpython-36.opt-1.pyc
|
|---|
3
¬`dA ã K @ s" d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl
m Z ddl
m Z ddl
mZ yddlmZmZ W n$ ek
r° ddlmZmZ Y nX ddlmZ ddlmZ ydd lmZmZmZ W n dd lmZmZmZ Y nX dd
l T ddl Z ydd l m Z W n" ek
rF dd l m Z Y nX dd l!m"Z# dd
l$m%Z% ddl$m&Z& ddl'm(Z( dZ)dZ*dZ+dZ,e j-ddddde j-dddddgZ.e j/d d d d e j/d d d!d e j/d"d d#d e j/d$dd%d&d'e j/d(e)d)d*d'e j/d+d d,d-d.e j/d/d0d1d2e j-d3dd4d5e j/d6d7d8d5g Z0e j-d9d:d;d5e j-d<dd=d5e j-d>dd?d5e j-d@ddAd5e j1dBdCdDd5gZ2e j1dEdFdGd5e j1dHdIdJd5e j/dKdLdMd5e j/dNdOdPd5e j/dQdRdSd5e j/dTdUdVd5e j/dWdXdYd5e j/dZd[d\d5e j3d]d^d_d`dadbdcgddd5e j-deddfd5e j-dgddhd5e j/didjdkd5e j/dldjdmd5e j1dnddod5gZ4e j/dpdqdrd5e j/dsdtdue j/dvdwdtd5e j/dxdydzd5e j/d{d|d}d5e j/d~ddd5e j/dddd5e j/dd
dd5e j/dddd5e j/dddd5e j/dddd5e j/dddd5e j/dddd5e j/dddd5e j/dddd5e j/dddd5e j1de+dd5e j1d e,d¡d5e j1d¢d£d¤d5e j/d¥d¦d§d5e j1d¨dd«d5e j1d¬ddd5e j/d®d¯d d°d'e j/d±d²d³d5e j/d´dµd¶d5e j/d·dµd¸d5e j/d¹dµdºd5e j/d»dµd¼d5e j/d½dµd¾d5e j/d¿dÀdÁd5e j/dÂdµdÃd5e j/dÄddÅd5e j/dÆdÇdÈd5e j/dÉdÊdËd5e j/dÌdÀdÍd5e j/dÎdÀdÏd5e j/dÐdÑdÒd5e j/dÓdÔdÕd5e j/dÖd×dØd5g'Z5e j6Z6e6j7e5 e6j8e0 e6j8e2 e6j8e4 e6j8e. y e9ej:dÙ Z;e6e;g W n e6ej<dCd
Y nX e#j=e j6e6j>j? e#j@e6j>j? ZAe dÚdۍZByre6jCj? dkr>eAjDjEe#jF nNe6jCj? dÜkr^eAjDjEe#jG n.e6jCj? dÝkr~eAjDjEe#jH neAjDjEe#jI W n& eJk
r´ eAjDjEe#j#jI Y nX ddCg dÞddddddddddddddߜ
d:ddµdµej:jKdàej:jKdáej:jKdâdµdµdd:dddµdµdµddddg ddd:ddd:dãdãdãdãdddä&ZLe
jM ZNdådæ ZOdçdè ZPdãZQdÚZRddlSZSeSjT ZUejVejW jXZYdéZZi a[dêZ\dëdì Z]dídî Z^dïdð Z_G dñdò dòZ`G dódô dôeaZbG dõdö döebZcG d÷dø døeaZdG dùd deZeddûdüZfdýdþ Zgdÿd Zheidkr eh dS ( ad Trilio Fuse plugin implimentation
This module is based on the vaultfuse.py module and will eventually
become the new vaultfuse.py module once integration and refactoring
of the existing vaultswift.py is complete.
Currently this module is temporary for the 2.6 release and will be merged
into a new vaultfuse.py for the next release.
é N)ÚThread)ÚBoundedSemaphore)Úmkstemp)ÚQueueÚEmpty)Úgetpwnam)ÚLRUCache)ÚFUSEÚ FuseOSErrorÚ
Operations)Ú*)Úcfg)Úlog)Úutils)Úvaults3)Úfsz%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2éd é ÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarr zlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated. Please use logging_context_format_string and logging_default_format_string instead.)r r r zlog-date-formatZ DATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)r Údeprecated_namer zlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)r r z
use-syslogzUse syslog for logging.)r r zsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTz Log output to standard errorZ use_journalz%Enable Systemd native journal supportZ use_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_bursté z Burst limitZlog_rotate_intervalé z0Interval, number of hours, of log rate limiting.Zmax_logfile_counté< z Number of log files to retain.Zlog_rotate_interval_typeZHoursz Units of log rotation intervalZlog_rotation_typeZintervalztype of log retentionZ logging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZ logging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levelsz amqplib=WARNzsqlalchemy=WARNz boto=WARNz suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Úvault_storage_typeZs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)r Úvault_data_directory_oldz/var/triliovaultÚtmpfs_mount_pathÚtmpfszLLocation with respect to CONF.vault_data_directory_oldwhere tmpfs is mountedZvault_storage_nfs_exportZlocalz
NFS ExportZvault_storage_nfs_optionsZnolockz NFS OptionsZvault_swift_auth_versionZ KEYSTONE_V2z KEYSTONE_V2 KEYSTONE_V3 TEMPAUTHZvault_swift_auth_urlzhttp://localhost:5000/v2.0zKeystone Authorization URLZvault_swift_tenantZadminz Swift tenantZvault_swift_usernamezSwift usernameZvault_swift_passwordZpasswordzSwift passwordZvault_swift_region_nameZ RegionOnezSwift Region NameZvault_swift_domain_idr zSwift domain idZvault_swift_domain_nameZDefaultzSwift domain nameZ vault_swift_container_prefixÚ TrilioVaultzSwift Container PrefixZvault_swift_segment_sizeZ33554432zDefault segment size 34MBÚ queue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_counté z(The number of times we retry on failuresZvault_swift_url_templatez,http://localhost:8080/v1/AUTH_%(project_id)sz The URL of the Swift endpointÚvault_segment_sizeé i z vault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileZvault_s3_auth_versionZDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚ z S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez S3 RegionÚvault_s3_bucketz S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚ vault_s3_sslÚTruezUse SSLÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionzS3 signature version to useÚvault_s3_support_empty_dirÚFalsez,S3 backend needs empty directory work aroundÚvault_s3_read_timeoutZ120z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolzEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Úvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).ZFLAGé )ÚvalueÚinfoÚwarnz1.0)
Z project_nameÚ region_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ tenant_idZ service_typeZ
project_idZ
auth_tokenZproject_domain_nameZ OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_tor ÚheaderÚ auth_versionÚ
os_optionsZssl_compressionZos_storage_urlZ os_usernameZ os_passwordZ os_cacertZos_certZos_keyZos_tenant_nameZ os_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclr> ZretriesZ write_aclÚmetar Zuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚ object_namec s t j fdd}|S )Nc
s t | |S Q R X d S )N)Ú
manifest_lock)ÚargsÚkwargs)Úwrapped© ú!/usr/lib/python3.6/s3vaultfuse.pyÚ_wrap¦ s zsynchronized.<locals>._wrap)Ú functoolsÚwraps)rO rR rP )rO rQ Ú synchronized¥ s rU c C sð dt d< tjt d< tjt d< tjt d< tjt d< tjt d< tjj dkrRd t d
< nd t d
< tj j dkrrd t d < nd t d < tj
rtj
t d
d< tj r¢tj t d
d< tj j dkrºd t d< n2t
jjtj rÔtj t d< ntjdtj dt d< d S )Nz1.0rE rG rH ZbucketZ s3_signatureZs3_read_timeoutÚtrueTZsupport_empty_dirFZs3_sslrF rA r@ ZfalseZ s3_ssl_certzcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connectionr- )ÚoptionsÚCONFr, r. r0 r5 r8 r6 Úlowerr2 r1 r/ r4 ÚosÚpathÚexistsÚLOGr? rP rP rP rQ Ú
option_config s0
r^ z
%016x.%08xiè c s t j fdd}|S )Nc s~ yt j jt j W n$ tk
r6 t j jt j j Y nX | |}yt j jt j W n$ tk
rx t j jt j j Y nX |S )N)ÚloggingÚdisableÚERRORÚ
BaseExceptionZNOTSET)rM rN Úresult)ÚfuncrP rQ ÚwrapperÝ s
z disable_logging.<locals>.wrapper)rS rT )rd re rP )rd rQ Údisable_loggingÜ s rf c C sV t jj| \}}d}x8|dkrL|dkr6t jj||}n|}t jj|\}}qW ||fS )Nr- ú/)r- rg )rZ r[ ÚsplitÚjoin)r[ ÚheadÚtailÚprefixrP rP rQ Úsplit_head_tailì s
rm c C s t jj| \}}|S )N)rZ r[ rh )r[ rj rk rP rP rQ Úget_headù s rn c @ s& e Zd Zd ddZdd Zdd ZdS )
Ú tmpfsfileFc C s || _ || _d S )N)ÚremoveÚ persist_exit)Úselfrp rq rP rP rQ Ú__init__ÿ s ztmpfsfile.__init__c C sL t jjtjtj}t|d\}| _t j| | j r>t j | j t
j | jS )N)Údir) rZ r[ ri rX r" r# r Ú open_fileÚcloserp Ú
tmpfs_semaÚacquire)rr Útmpfs_mountpathÚfhrP rP rQ Ú __enter__ s
ztmpfsfile.__enter__c G s | j stj tj| j d S )N)rq rw ÚreleaserZ rp ru )rr rM rP rP rQ Ú__exit__ s ztmpfsfile.__exit__N)FF)Ú__name__Ú
__module__Ú __qualname__rs r{ r} rP rP rP rQ ro þ s
ro c @ s e Zd Zdd Zdd Zdd Zdd Zd d
Zd d Zd
d Z dd Z
d ddZ d ddZ dd Z
dd Zdd Zd d ZdS ) ÚObjectRepositoryc K s
|| _ d S )N)Úroot)rr r rN rP rP rQ rs s zObjectRepository.__init__c C s. |j dr|dd
}tjjt|}| j|S )Nrg r )Ú
startswithrZ r[ ri Ú_SEGMENT_PREFIXÚ
_full_path)rr Úpartialr[ rP rP rQ Ú_full_segment_path s
z#ObjectRepository._full_segment_pathc C s* |j dr|dd
}tjj| j|}|S )Nrg r )r rZ r[ ri r )rr r r[ rP rP rQ r
% s
zObjectRepository._full_pathc C s d S )NrP )rr rK ÚflagsrP rP rQ Ú object_open+ s z ObjectRepository.object_openc C s d S )NrP )rr rK ÚoffÚbufrz rP rP rQ Ú
object_upload. s z ObjectRepository.object_uploadc C s d S )NrP )rr rK Úoffsetrz rP rP rQ Úobject_download1 s z ObjectRepository.object_downloadc C s d S )NrP )rr rK rP rP rQ Ú
object_delete4 s z ObjectRepository.object_deletec C s d S )NrP )rr rK rz rP rP rQ Ú object_close7 s z ObjectRepository.object_closeNc C s d S )NrP )rr rK Úlengthrz rP rP rQ Úobject_truncate: s z ObjectRepository.object_truncatec C s d S )NrP )rr rK rz rP rP rQ Úobject_getattr= s z ObjectRepository.object_getattrc C s d S )NrP )rr r[ rz rP rP rQ Úobject_readdir@ s z ObjectRepository.object_readdirc C s d S )NrP )rr r[ ÚmoderP rP rQ Ú
object_accessC s z ObjectRepository.object_accessc C s d S )NrP )rr r[ rP rP rQ Ú
object_unlinkF s z ObjectRepository.object_unlinkc C s d S )NrP )rr r[ rP rP rQ Ú
object_statfsI s z ObjectRepository.object_statfs)N)N)r~ r r rs r r
r r r r r r r r r r r rP rP rP rQ r s
r c sd e Zd Z fddZG dd deZG dd dZdd Zd d
Zd d Z d
d Z
dd Z i fddZ dd Z
edd Zdd Zdd Zedd Zd d Zd d Zed!d" Zd#d$ ZdMd&d'Zd(d) Zd*d+ Zd,d- Zd.d/ Z dNd0d1Z d2d3 Z d4d5 Z dOd7d8Z d9d: Z!dPd;d<Z"d=d> Z#d?d@ Z$dAdB Z%dCdD Z&dEdF Z'dGdH Z(dQdIdJZ)dKdL Z* Z+S )RÚBackendRepositoryc sT t t| j|f| ttj| _ttj| _i | _ t
j t | _
i | _i | _i | _d S )N)Úsuperr rs r Ú FUSE_USERÚpw_uidrB Úpw_gidÚgroup_idÚmanifestr Ú S3BackendrW Ú_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ _BackendRepository__worker_poolÚ _BackendRepository__pending_ios)rr r rN )Ú __class__rP rQ rs N s zBackendRepository.__init__c @ s0 e Zd ZdZdd Zdd Zdd Zdd Zd
S ) z BackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
c C s8 t j| tj|| _|| _tj | _d| _ | j
d S )NT) r rs r r Ú_BackendWorker__backendÚ_BackendWorker__job_queueÚ threadingZEventÚ _stop_eventZdaemonÚstart)rr Ú job_queuerW rP rP rQ rs n s
z(BackendRepository.BackendWorker.__init__c C s | j j d S )N)r© Úset)rr rP rP rQ Ústopx s z$BackendRepository.BackendWorker.stopc C s
| j j S )N)r© Zis_set)rr rP rP rQ Ústopped{ s z'BackendRepository.BackendWorker.stoppedc C s¤ t jdtj j x| j sy<| jjdd\}}}z|| jf|| W d| jj X W q t
k
rp wY q t k
r } zt j | W Y dd}~X qX qW dS )zO Start up the worker and block until there is an item in the queue
zStarting worker thread[%x].Tr N)
r] r> r¨ Úcurrent_threadÚidentr® r§ Úgetr¦ Z task_doner Ú ExceptionÚ exception)rr rd rM ÚkargsÚerP rP rQ Úrun~ s
z#BackendRepository.BackendWorker.runN)r~ r r Ú__doc__rs r r® r¶ rP rP rP rQ Ú
BackendWorkerj s
r¸ c @ s8 e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd S )
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
c C s> t tj| _g | _x&t|D ]}| jjtj| j| q W d S )N) r rX r& r« ÚworkersÚrangeÚappendr r¸ )rr Z num_threadsrW Ú_rP rP rQ rs s
z,BackendRepository.BackendWorkerPool.__init__c C s4 x| j D ] }|j qW x| j D ] }|j q W d S )N)r¹ r ri )rr ÚtrP rP rQ Ú__del__ s z+BackendRepository.BackendWorkerPool.__del__c O s | j j|||f dS )z+ Add a job to the worker queue
N)r« Zput)rr rd rM r´ rP rP rQ Úadd_job¦ s z+BackendRepository.BackendWorkerPool.add_jobc C s x|D ]}| j || qW dS )z4 Add a list of jobs to the worker queue
N)r¿ )rr rd Z args_listrM rP rP rQ Úmap« s
z'BackendRepository.BackendWorkerPool.mapc C s | j j dS )z> Wait for completion of all the jobs in the queue
N)r« ri )rr rP rP rQ Úwait_completion± s z3BackendRepository.BackendWorkerPool.wait_completionN) r~ r r r· rs r¾ r¿ rÀ rÁ rP rP rP rQ ÚBackendWorkerPool s r c C sV t jj|\}}d}x8|dkrL|dkr6t jj||}n|}t jj|\}}qW ||fS )Nr- rg )r- rg )rZ r[ rh ri )rr r[ rj rk rl rP rP rQ rm ¶ s
z!BackendRepository.split_head_tailc C s t jj|\}}|S )N)rZ r[ rh )rr r[ rj rk rP rP rQ Ú _get_head s zBackendRepository._get_headc C s. |j dr|dd
}tjjt|}| j|S )Nrg r )r rZ r[ ri r Ú
_get_cache)rr r r[ rP rP rQ Ú_get_segment_cacheÆ s
z$BackendRepository._get_segment_cachec C s* |j dr|dd
}tjj| j|}|S )Nrg r )r rZ r[ ri r )rr r r[ rP rP rQ rÄ Ì s
z BackendRepository._get_cachec C s> | j |\}}i }i }tj }||d< t|}| jj|}|S )NrK )rm rW ÚcopyÚbunchifyr¡ Zget_object_manifest)rr rK Ú containerrl Ú put_headersÚmrÚ_optsr rP rP rQ Ú_read_object_manifestÒ s z'BackendRepository._read_object_manifestc C sl | j |\}}i }i }d|d< tj }||d< x |j D ]\} }
|
|d| < q8W t|}| jj||| d S )NrV zx-static-large-objectrK zx-object-meta-)rm rW rÆ ÚitemsrÇ r¡ Zupload_object_manifest) rr rK Úobject_manifestÚmetadatarÈ rl rÉ rÊ rË rH r= rP rP rQ Ú_write_object_manifestæ s
z(BackendRepository._write_object_manifestc C sÈ | j |\}}tj }|dkr$g }n|g}d |d< d|d< d|d< d|d< d |d< t|}i }|dkrz||d< |j| nd }| jj||}i }x2|d j D ]"\} }
d | kr|
|| jd
d < qW |S ) Nr- Ú delimiterFÚhumanÚtotalsÚlongrl Úheadersz
x-object-metazx-object-meta-r ) rm rW rÆ rÇ r» r¡ Ú stat_objectrÍ rh ) rr rK rÈ rl rË rM r ÚstrÏ rH r= rP rP rQ Ú_get_object_metadataÿ s, z&BackendRepository._get_object_metadatac I C s~ | j |\}}| j|}| jj|tj | j|< |tjkpX|tddtddtddfk}| j| Z || j kr¼di i| j |< |tjksæ|tddtddtddfksæ|tddtddfksæ|tddtd dtd
dfkr0y| j
|}W nF t k
r: } z(t j
d | tjd | j
|}W Y d d }~X nX xJ|D ]B} | d
jdd jdd }
t|
d} d| d< | | j | | < qBW | j|} | d | j | d< y"| j| j | d }
tj|
W n tk
rÜ Y nX tjjtjj|stjtjj| t|d}|jtj| W d Q R X ntjjtjj|sXtjtjj| |tddtddtddfks|tjkrÞy| j | W n tk
rª Y nX yt|d}W d Q R X W n tk
rÜ Y nX y | j |d }
tj|
W n tk
r Y nX tj||}z:| j t j t!| j"|< ddi| j | d |< | j#|| W d | j"j$|d | j | d j$|d tj%| X yt|d}W d Q R X W n tk
rº Y nX W d Q R X tj||}y:d|i| j | d |< | j t j t!| j"|< t& | j'|< |S t k
rx } zNt j(| | j"j$|d | j | d j$|d | j'j$|d tj%| W Y d d }~X nX d S )NZ8000é Z8800Zc000Ú open_handlesZ8401Z8402Z8002Z8802Zc002z+Manifest for %s not found. Trying in 5 secsr Únamez
-segments/r Ú.r FÚmodifiedz segments-dirÚwZ8001Z8801Z0001z -segmentsÚreadonly))rm r
r¢ r± r¨ ÚRLockrZ ÚO_RDONLYÚintr rÌ r² r] r> ÚtimeÚsleeprh rØ Úmakedirsrb r[ r\ ÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_RDWRr r r rX r' rW r£ Ú
_object_closeÚpoprv r¬ r¤ r³ )rr rK r rÈ rl Ú full_pathrß r ÚexÚsegZoffstrr rÏ Z segment_dirÚfrz rP rP rQ r : s®
"
z BackendRepository.object_openc C sx yFg }x |D ]}|j tjj|| q W tj }t|}|j|| W n, tk
rr } zt j
| W Y dd}~X nX dS )a4 Utility method to be dispatched to a worker thread in order to clean up old segments.
Args:
backend (class instance): Instance of the backend plugin.
container (str): Container name, a.k.a root directory.
segment_list (list): List of segments to remove.
N) r» rZ r[ ri rW rÆ rÇ Údelete_object_listr² r] r³ )rr ÚbackendrÈ Ú segment_listZ delete_listÚobjrË rï rP rP rQ Z__purge_old_segments_task½ s
z+BackendRepository.__purge_old_segments_taskc C s | j | j | j| z yB| j| jddt | d }| j|\}}g }i }d}| j| d | d s^d} d}
d} x | | j| krP y | j| j| | d |} W n0 tj d | j| j| | d |} Y nX | j| | d r2t
| }
t |
j t
j} |j| j| | d |
j| |
jd
nP| j| | d } |j| j| | d | j| | d | | j| | d
d
| t
j7 } |d7 }|
| 7 }
qW | j|||t|t|
dd d} xdr\|r\| j||| }t|dkrðP t|}| j| j| | d \}}tt|t|g }t|dkrN| j | j| j|| | t
j7 } qÆW dS tk
r } zt j | W Y dd}~X nX W dQ R X dS )zé Handle object_close by updating the manifest.
Waits for all of the background jobs to complete prior to updating
manifest using the main thread. Also queues up tasks to clean up
any old segments.
z segments-dirrg z -segmentsr rÚ rß rÛ r rÝ )r[ ÚetagÚ
size_bytesÚ content_typer÷ Úhashrø r )z segments-dirz
segment-countz
total-size)rÏ TN) r£ rÁ r¢ r r± r rm r rã rä rÇ ÚminÚst_sizerX r) r» rö rø rÐ Ústrrô ÚlenÚsortedÚlistr¬ r¿ Ú+_BackendRepository__purge_old_segments_taskr² r] r³ )rr rK rz Ú segments_dirrÈ rl rÎ Z
segments_listZsegmentsr Z
total_sizeÚ segment_sizer× ÚstatZobjectsÚcÚpZ
purge_listrï rP rP rQ rì Ð s
z BackendRepository._object_closec C sÚ | j || | jj| | jj| | j| d j| ytj| W n tk
rZ Y nX | j| R t | j| d dkr´ytj
| j | W n tk
r¦ Y nX | jj| W d Q R X || jkrÖ| jj|d d S )NrÚ r ) rì r£ rí r¤ r rZ rv rb r¢ rý rp r
)rr rK rz rP rP rQ r J s"
z BackendRepository.object_closec # C s | j | t y*|| j| krJ| j| | d dkrJ| j| | d }n8| j||}| j| jddt | d }tjj||}tj }d| j| k|d< | j
|\} }
t dd 2} t | d
} | j
| W d Q R X t||d < W d Q R X |
jd|d < t|}| | g}
| j| j| | j| j| j|
||||| W n@ tk
rz } z"tj| | j| j| W Y d d }~X nX W d Q R X d S )
NrÝ TrÛ z segments-dirrg z -segmentsÚ0Z
path_valid)rq Úwbr rK )r¢ r Ú,_BackendRepository__next_segname_from_offsetr± r rZ r[ ri rW rÆ rm ro rç rè rý ÚrstriprÇ r¤ Úaddr£ r¿ Ú&_BackendRepository__object_upload_taskr² r] r³ rp )rr rK r r rz Ú seg_fullnameZsegnamer rË rÈ rõ Útempfsrñ Úargs1rï rP rP rQ r ` s8
z BackendRepository.object_uploadc * C s t jd||tj jf | j| W dQ R X zjy|j|| W nT tk
r } z8t j| | j| | j | j
| W dQ R X W Y dd}~X nX W dt j t
j
|d X | j| V || j| krÜi | j| |< || j| | d< d| j| | d< | j | j
| W dQ R X dS )zP Method run by a worker in the thread pool to upload an object segment.
z6Object [%s] segment [%s] upload running in thread[%x].Nr rÛ TrÝ )r] r> r¨ r¯ r° r¢ Z
upload_objectr² r³ r¤ rp rw r| rZ r ) rr ró r rË rK r r rz rï rP rP rQ Z__object_upload_task s(
z&BackendRepository.__object_upload_taskc
C sH xvt jd | j| X || j| kr(w|| j| krVtd| tt|tdf | j| | d }P W d Q R X qW | j|j d\}}t
dd¨}t j }d |d< d |d < |j d|d
< t
|}||g} y:| jj| | t|j dd }
|
j } W d Q R X t| S tk
r8 } ztj| W Y d d } ~ X nX W d Q R X d S ) Ng¹?zobject %s not foundr rÛ rg T)rp rl Z
out_directoryZout_fileÚrb)rã rä r¢ r¤ r r² ÚSEGMENT_FORMATrâ rm r ro rW rÆ rÇ r¡ Zdownload_objectrç ÚreadÚ bytearrayr] r³ )
rr rK r rz r rÈ rõ r
rË r rñ r rï rP rP rQ r ª s6
z!BackendRepository.object_downloadc C s | j | | j|\}}tj }t|}|g}|dkrJ|dkrJ|j| y| jj|| W n, tk
r } zt j
| W Y d d }~X nX W d Q R X d S )Nr- rg ) r¢ rm rW rÆ rÇ r» r¡ Ú
delete_objectr² r] r³ )rr rK rÈ rõ rË r rï rP rP rQ r Ì s
z BackendRepository.object_deleteNc C s& |rd S | j |tj}| j|| d S )N)r rZ ÚO_WRONLYr )rr rK r rz rP rP rQ r Ü s z!BackendRepository.object_truncatec C sp t j }d |d< d|d< d|d< d|d< tjj|dt| |d< g }|dkrTg }n|g}t|}| jj||S ) NrÑ FrÒ rÓ rÔ z%016xrl r- ) rW rÆ rZ r[ ri râ rÇ r¡ Z
list_segments)rr rÈ r r rË rM rP rP rQ rô â s z BackendRepository.segment_listc C sÀ | j |\}}| j| jdd }|rT|jdt r@| j |\}}| j |\}}|}n|d }| j|||}t|dkrtt|tdf S tt|tt |d j
|d j
dd dd f S ) Nz segments-dirrg z -segmentsr r rÜ rÙ éÿÿÿÿ) rm r r± r r rô rý r râ rþ rh ) rr r[ r rÈ rl r r r ÚfilesrP rP rQ Z__next_segname_from_offsetô s $z,BackendRepository.__next_segname_from_offsetc
C sò | j | | j|\}}| jj|d rV|| j| krV| j| | d }|jdd S | j| jdd }|r| j|\}}|}n|d }| j|||} W d Q R X t| dkrÀtt|tdf S tt|tt | d j|d jdd df S )
NrÛ z
-segments/r z segments-dirz -segmentsr rÜ rÙ r )
r¢ rm r r± rh rô rý r râ rþ )
rr r[ r rÈ rl rð r r r r rP rP rQ Úcurr_segname_from_offset s z*BackendRepository.curr_segname_from_offsetc s t jj|r~y@t j| t fdddD }d |d < t|d d |d
< |S tk
rx } ztj| W Y dd}~X nX dS dS )aÆ Utility to check the tmpfs cache and return stat() from that.
This method looks to see if the object (directory) exists in the
local cache and will perform a stat() locally instead of calling
all the way to the backend.
Args:
object_cache_path (str): Cache path to the object we need stat infor on.
Returns:
Dictionary of stat() information or None if object does not exist.
c 3 s | ]}|t |fV qd S )N)Úgetattr)Ú.0rH )r× rP rQ ú <genexpr>4 s z0BackendRepository._stat_cache.<locals>.<genexpr>Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkrû Úst_uidi Ú
st_blksizeÚ st_blocksN)r r r r r r rû r! ) rZ r[ ÚisdirÚlstatÚdictrâ r² r] r³ )rr Zobject_cache_pathÚ stat_inforµ rP )r× rQ Ú _stat_cache" s(
z BackendRepository._stat_cachec
$ sR | j |}| j|}|d k r |S | j|\}}tj }|dkrDg }n|g}d |d< d|d< d|d< d|d< d |d< t|}i }|dkr||d< |j| nd }yN| jj|| | j |d< | j
|d < d
j d d|d < d
j d
d|d< t d |d< t d |d< t d |d< d|d< d|d< |d k rHd|krHd|d< t d |d< |d dkrp|dks®|d dkr|d ks®|d dkr |dks® d d krêd |d< d |d< d |d< | j
|} tjj| sêtj| d! W nB tk
r0 }
z"|d kr|}| j
tjj||}| j|} ytj| W n tk
rÜ |} t| dkrj| j yVtjj|d d|d< | jj| | t dkr´tjtjj|d! n
tj | W n tk
rÖ Y nX Y nX |d"ksü|d d)
j d#r d S tj| t fd$d%d*D }W Y d d }
~
X nX d&|d'< t |d d& |d(< |S )+Nr- rÑ FrÒ rÓ rÔ rl r r! rÕ ZETagrö Z ContentTyperø Z timestampr r r r r ií r Zauthorized_keyi Úsizerû r Z directoryTé i iýA ié Z4913ú~c 3 s | ]}|t |fV qd S )N)r )r rH )r× rP rQ r s z3BackendRepository.object_getattr.<locals>.<genexpr>i r" r# r )r r r r r r rû r! ) r
r( rm rW rÆ rÇ r» r¡ rÖ r rB r± râ rÄ rZ r[ r\ Úmkdirr² ri rà r% rb rý rí Ú list_objectsræ r] r> Úendswithr& )
rr rK rz rî r rÈ rl rË rM Zcontainer_pathrï Úmkdirsr rP )r× rQ r K s
z BackendRepository.object_getattrc c sL g }| j |\}}tj }d |d< d|d< d|d< d|d< d |d< g }|dkrTg }n"|g}|dkrv|d k rv|d |d< g }t|}|| jj||7 }x|D ]} | j | \}
} |
dks¼| dkrøtjj|| j | } ytj
| d d
W n t k
rö Y nX |
d k r|
dkrd |
krd |
kr|
|kr|j |
qW xt
|D ] }
|
V q8W d S )
NrÑ FrÒ rÓ rÔ rl r- rg ié )r z -segmentsZ _segments)rm rW rÆ rÇ r¡ r- rZ r[ ri rà rå rb r» rÿ )rr rK rz ZlistingrÈ rl rË rM ÚdirentsZlstZ componentÚrestr/ ÚrrP rP rQ r ® sB
z BackendRepository.object_readdirc C s d S )NrP )rr rK r rP rP rQ r Ý s z BackendRepository.object_accessFc C sN |t d< t j }t|}|sØy| j|}| j|}g }x|D ]}|j|d q<W | jj|| |jd}|d k r¨|g} | jj | | yt
j | j | W n Y nX W n, t
k
rÖ }
ztj|
W Y d d }
~
X nX | j|\} } | g}
| dkoú| dkr|
j| y| jj|
| W n. t
k
rH }
ztj|
W Y d d }
~
X nX d S )NrJ rÛ z segments-dirr- rg )rW rÆ rÇ rÌ rØ r» r¡ rò r± Ú rmdir_objectrZ ÚrmdirrÄ r² r] r³ rm r )rr rK rJ rË Z obj_manifestZ obj_metadatarô Úmanr rM rï rÈ rõ r rP rP rQ r à s>
z BackendRepository.object_unlinkc C sÐ t j }t|}g }y| jj||}W n6 tk
r\ } ztj| tt j
W Y d d }~X nX d|d krt |d }t |d t |d }nd }t |d }i }||d< ||d< ||d< d |d
< d |d < |S )
Nzx-account-meta-quota-bytesrÕ zx-account-bytes-usedr r) Úf_blocksÚf_bfreeÚf_bavailr Úf_favailÚf_frsizer ) rW rÆ rÇ r¡ rÖ r² r] r³ r
ÚerrnoÚENOENTrâ ) rr rK rË r Zstvrï r6 r8 ZdtrP rP rQ r s*
z BackendRepository.object_statfsc
C sÚ t jd| | j|\}}tj }t|}||g}y| jj|| W n* tk
rp } zt j | dS d }~X nX | j
|} |dkr| j
t j j
||} yt j| | W n, tk
rÔ } zt j | W Y d d }~X nX dS )Nz mkdir, %sr F)r] r rm rW rÆ rÇ r¡ Z mkdir_objectr² r³ rÄ rZ r[ ri rå )
rr r[ r ZistrÈ rõ rË rM rï Ú
cache_pathrP rP rQ r, " s$
zBackendRepository.mkdirc
: C sÖ | j |\}}tj }d |d< t|}|g}|dkrF|dkrF|j| g }y|| jj||dd7 }W n, tk
r } ztj | W Y d d }~X nX t
|dkr¨t t j
y| jj|| W n, tk
ræ } ztj | W Y d d }~X nX |jdt y|| jj||dd7 }W n. tk
r< } ztj | W Y d d }~X nX t
|dkry| jj|| W n. tk
r } ztj | W Y d d }~X nX | j|}tjj|r°tj| | j|} tjj| rÒtj| S d S )Nrl r- rg r( )Z max_itemsr )rm rW rÆ rÇ r» r¡ r- r² r] r³ rý r
r; Z ENOTEMPTYr3 Úinsertr rÅ rZ r[ r$ r4 rÄ )
rr r[ rÈ rõ rË r Z dir_itemsrï Zsegment_cache_pathr= rP rP rQ r4 B sH
zBackendRepository.rmdirc C sV t jd| y.| j|\}}| jtjj||}tj||S tk
rP Y nX d S )Nz chmod, %s) r] r rm rÄ rZ r[ ri Úchmodrb )rr r[ r rÈ rl r= rP rP rQ r? q s zBackendRepository.chmodc C sX t jd| y0| j|\}}| jtjj||}tj|||S tk
rR Y nX d S )Nz chown, %s) r] r rm rÄ rZ r[ ri Úchownrb )rr r[ ÚuidÚgidrÈ rl r= rP rP rQ r@ z s zBackendRepository.chownc C s t dd S )NzNot Applicable)r² )rr rÛ ÚtargetrP rP rQ Úsymlink s zBackendRepository.symlinkc
[ C s | j j|d r2tjd | j j|d r2td| tjd||f |d }y| j|dd W n, tk
r } ztj| W Y d d }~X nX yJ| j |}| j |}|jd|d |jd|d krÔ| j|dd d S W n" tk
rø } zW Y d d }~X nX d
}y®y| j |}W n$ tk
r2 } zW Y d d }~X nxX | j
|}|jd|d } g }
x2|D ]*} |
j | d | d | d
| d d qXW | j ||
| |d |d dd d}W n0 t
k
rÜ } ztj| W Y d d }~X nX zàyÂ| j
|} | j |}|jd|d } g }x2| D ]*} |j | d | d | d
| d d qW | j ||| |d |d dd y| j|dd W n. tk
r } ztj| W Y d d }~X nX W n t
k
rº Y nX W d |ry| j|d
d W n. tk
r } ztj| W Y d d }~X nX X d S )Nr z%s in use. Try againzrename, %s -> %sr+ T)rJ z segments-dirz -segmentsr FrÛ rù r÷ rø )r[ rö r÷ rø z
segment-countz
total-size)z segments-dirz
segment-countz
total-size)rÏ )r r± rã rä r² r] r r r³ rØ rÌ r» rÐ rb )
rr ÚoldÚnewZ newbak_namerï Z new_metadataZ old_metadataZnewfile_existsZ new_manifestr Znewbak_manifestr5 Z old_manifestrP rP rQ Úrename s
zBackendRepository.renamec C sZ t jd| t|\}}| jtjj||}t|\}}| jtjj||}tj||S )Nzlink, %s)r] r rm rÄ rZ r[ ri Úlink)rr rC rÛ rÈ rl Zcache_path_targetZcache_path_namerP rP rQ rH ÷ s zBackendRepository.linkc C sN t jd| t|\}}| j|}ytj|| W n tk
rH dS X dS )Nz utimens, %sr )r] r rm rÄ rZ Úutimerb )rr r[ ÚtimesrÈ rl r= rP rP rQ Úutimensÿ s
zBackendRepository.utimensc C sX y>t jjtjtj}t jj|r<t jj|r<tj |d dd W n t
k
rR Y nX dS )Né )Ztimeoutr ) rZ r[ ri rX r" r# r$ Úismountr Úumountrb )rr r[ ry rP rP rQ Údestroy s
zBackendRepository.destroy)N)N)F)F)N),r~ r r rs r r¸ r rm rà rÅ rÄ rÌ rÐ rØ rU r r rì r r r rf r r r rô r r r( r r r r r r, r4 r? r@ rD rG rH rK rO Ú
__classcell__rP rP )r¥ rQ r M sL )# ; z )! "
)
c/
#
/ q
r c @ sp e Zd Zdd Zdd ZdddZdd Zd d d Zd
d Zdd Z dd Z
dd Z dd Z dd Z
dd Zd
S ) Ú FuseCachec C sb || _ || _t| _ttj| _ttj| _t j
j | j sy4t j
| j t j| j t| jd t| j g W qÎ tk
r Y qÎX nHt j| j }|j| jksª|j| jkrÎt jtjt| jd t| j g yvt j
jtjtj}t j
j |søtj| t j
j|sBdttj ttj }dd|d }t j dd|d|g W n tk
r\ Y nX d S )Nú:r< zsize=%dM,mode=0777r( i r$ z-o) r Ú
repositoryÚlrucacher r r rB r r rZ r[ r$ r r, r@ rü rb r r! r rX r" ri r# r Z ensure_treerM râ r) r+ Zmount)rr r rS r' ry Z
tmpfs_sizeZtmpfs_buffer_cfgrP rP rQ rs - s6 (
$
zFuseCache.__init__c C sL | j j||}| jj|d r(| jj| ttjdtj |t
d| j|< |S )N)Úmaxsize)rT ÚlrulockrK Ú writes_before_update_manifest) rS r rT r± rí r rX r+ r¨ ÚLockÚNUMBER_UPLOADS_BEFORE_FLUSH)rr rK r rz rP rP rQ r R s
zFuseCache.object_openTc C s t jd|tj jf | j| }|d }|d P y4x.|j \}}|d r8| jj|||d | q8W W n t k
r| Y nX W d Q R X |r| jj
|| d S )Nz Cache object_flush [%s] [%x]rT rV rÝ Údata) r] r r¨ r¯ r° rT ÚpopitemrS r ÚKeyErrorrì )rr rK rz Úupdate_manifestÚitemÚcacher rP rP rQ Ú object_flush_ s
zFuseCache.object_flushc C sF t jd|tj jf | j||dd | jj|| | jj | d S )Nz Cache object_close [%s] [%x]F)r] )
r] r r¨ r¯ r° r` rS r rT rí )rr rK rz rP rP rQ r v s zFuseCache.object_closeNc C s | j j||| d S )N)rS r )rr rK r rz rP rP rQ r s zFuseCache.object_truncatec c sV xP|dkrP|t j t j }|| }t|t j| }|||fV ||7 }||8 }qW d S )Nr )rX r) rú )rr r r Z
seg_offsetÚbaseÚseg_lenrP rP rQ Ú_walk_segments s
zFuseCache._walk_segmentsc ! C sp t }| j| d L xB| j||D ]0\}}}y| j| d | d } W nö tk
rD y²| j| d }
t|
tjkrè|
j \} } | d rè| jj || | d | | j| d d8 < | j| d sè| jj
|| t | j| d< | jj |||} d| d| j| d |< W n, t
k
r> }
ztj|
d S d }
~
X nX Y nX || |||
7 }q(W W d Q R X t|S )
NrV rT rZ rÝ rW r F)rÝ rZ r )r rT rc rb rý rX r+ r[ rS r rì rY r r² r] r³ Úbytes)rr rK r r rz Z
output_bufÚ segoffsetra rb Úsegdatar_ r r^ rï rP rP rQ Ú object_read s>
"zFuseCache.object_readc C sÀ t jd|tj jf t|}d}| j| d ~ xt| j||D ]b\}}} | j| d }
||
krFt|
tj krâ|
j
\} } | d râ| j j || | d | | j| d d8 < | j| d sâ| j j
|| t| j| d< y4| j j|||}
|
d krtd d
|
d |
|< W n, tk
rB td}
d |
d |
|< Y nX n |
| d }
t|
|k rz|
jd
|| t|
||||
|
|||
< d |
| d< || 7 }qFW W d Q R X t|S )Nz Cache object_write [%s] [%x]r rV rT rÝ rZ rW r zObject not foundF)rÝ rZ Tó )r] r r¨ r¯ r° rý rT rc rX r+ r[ rS r rì rY r r² rb r Úextend)rr rK r r rz r Zbufptrre ra rb r_ r r^ rf rP rP rQ Ú object_writeÇ sL
zFuseCache.object_writec C s t j| jj||S )N)rZ r, rS r
)rr r[ r rP rP rQ r, s zFuseCache.mkdirc C s | j j|}tj|S )N)rS r
rZ r4 )rr r[ rî rP rP rQ r4 s zFuseCache.rmdirc C s | j j|}tj||S )N)rS r
rZ r? )rr r[ r rî rP rP rQ r? " s zFuseCache.chmodc C s | j j|}tj|||S )N)rS r
rZ r@ )rr r[ rA rB rî rP rP rQ r@ & s zFuseCache.chown)T)N)r~ r r rs r r` r r rc rg rj r, r4 r? r@ rP rP rP rQ rQ , s %
9TrQ c @ sÚ e Zd Zd2ddZdd Zdd Zdd Zed3d
d Zd d
Z dd Z
dd Z dd Z dd Z
dd Zdd Zdd Zd d Zd d Zd4d d!Zd"d# Zd5d$d%Zd&d' Zd(d) Zd6d*d+Zd,d- Zd.d/ Zd0d1 ZdS )7r% Nc C s& || _ |pt|| _t|| j| _d S )N)r r rS rQ r_ )rr r rS rP rP rQ rs + s zTrilioVault.__init__c C s | j j|| d S )N)rS r )rr r[ r rP rP rQ Úaccess3 s zTrilioVault.accessc C s | j j||S )N)rS r? )rr r[ r rP rP rQ r? 6 s zTrilioVault.chmodc C s | j j|||S )N)rS r@ )rr r[ rA rB rP rP rQ r@ 9 s zTrilioVault.chownc C s | j j||S )N)rS r )rr r[ rz rP rP rQ r < s zTrilioVault.getattrc c s4 ddg}|j | jj|| x|D ]
}|V q"W d S )NrÜ z..)ri rS r )rr r[ rz r0 r2 rP rP rQ Úreaddir@ s
zTrilioVault.readdirc C s2 t j| j|}|jdr*t jj|| jS |S d S )Nrg )rZ Úreadlinkr
r r[ Úrelpathr )rr r[ ÚpathnamerP rP rQ rm F s
zTrilioVault.readlinkc C s t j| jj|||S )N)rZ ÚmknodrS r
)rr r[ r ZdevrP rP rQ rp X s zTrilioVault.mknodc C s | j j|S )N)rS r4 )rr r[ rP rP rQ r4 [ s zTrilioVault.rmdirc C s | j j||S )N)rS r, )rr r[ r rP rP rQ r, ^ s zTrilioVault.mkdirc C s | j j|S )N)rS r )rr r[ rP rP rQ Ústatfsa s zTrilioVault.statfsc C s | j j|S )N)rS r )rr r[ rP rP rQ Úunlinkd s zTrilioVault.unlinkc C s | j j||S )N)rS rD )rr rÛ rC rP rP rQ rD g s zTrilioVault.symlinkc C s | j j||S )N)rS rG )rr rE rF rP rP rQ rG j s zTrilioVault.renamec C s | j j||S )N)rS rH )rr rC rÛ rP rP rQ rH m s zTrilioVault.linkc C s | j j||S )N)rS rK )rr r[ rJ rP rP rQ rK p s zTrilioVault.utimensc C s | j j||S )N)r_ r )rr r[ r rP rP rQ rç v s zTrilioVault.openc C s | j |tjS )N)rç rZ ÚO_CREAT)rr r[ r ZfirP rP rQ Úcreatey s zTrilioVault.createc C s | j j||||}|S )N)r_ rg )rr r[ r r rz r rP rP rQ r | s zTrilioVault.readc C s | j j||||S )N)r_ rj )rr r[ r r rz rP rP rQ rè s zTrilioVault.writec C s | j j|||d d S )N)rz )r_ r )rr r[ r rz rP rP rQ Útruncate s zTrilioVault.truncatec C s | j j|| d S )N)r_ r` )rr r[ rz rP rP rQ Úflush s zTrilioVault.flushc C s | j j|| d S )N)r_ r )rr r[ rz rP rP rQ r| s zTrilioVault.releasec C s t jd| | jj|S )Nz destroy, %s)r] r rS rO )rr r[ rP rP rQ rO s zTrilioVault.destroy)N)N)N)N)N) r~ r r rs rk r? r@ rf r rl rm rp r4 r, rq rr rD rG rH rK rç rt r rè ru rv r| rO rP rP rP rQ r% * s2
ú/etc/fuse.confc C sÐ d}t jj| rJt| d*}x"|D ]}d|kr"d|kr"d}P q"W W d Q R X |dkrÌd}t jj| rt| d}|j d d }W d Q R X td d
}|j| W d Q R X tjd | tjd tj d d g d S )
Nr r2 Zuser_allow_otherú#r zuser_allow_other
ZrtÚ
z/tmp/fuse.conf.tmpZwtz/etc/fuse.confz root:root)
rZ r[ r\ rç r rè r rÆ rp r@ )Z conf_fileÚfoundrñ ÚlineÚsZoutfrP rP rQ Ú fuse_conf s"
r} c C s yyt j| dg W n tk
r( Y nX tjj| rPt j| dtd t g nHt j | dg t j |dg t j| td t g t j|td t g W n, t
k
rÆ } zt j | W Y d d }~X nX dd tj
tjD t|t|d}d}tjj d krd
}t|| |ddddd d S ) Nz-lz-RrR z-pc S s& g | ] }t jtjjtj|d dqS )T)Ú
ignore_errors)ÚshutilZrmtreerZ r[ ri rX r" )r ÚxrP rP rQ ú
<listcomp>¼ s zmain.<locals>.<listcomp>)rS TrV F)Z nothreadsZ
foregroundZnonemptyZ
big_writesZ allow_other)r rN rb rZ r[ r$ r@ r Ú
FUSE_GROUPr, r² r] r³ ÚlistdirrX r" r% r r9 rY r )Z
mountpointZ cacherootrï Z tvaultpluginZdisable_fuse_threadsrP rP rQ Úmain¨ s8 r c C s t t ttjtj dS )z$Main routine that drives fuse mount.N)r^ r} r rX r! r" rP rP rP rQ r¶ Ô s r¶ Ú__main__i i )rw )jr· rZ ZgrpÚsysr; rã ré r rS Ú
subprocessr¨ r r Ztempfiler r r Ú ImportErrorZqueueÚpwdr Z
cachetoolsr Zfuser r
r ZfusepyZs3fuse.bunch_p3ZastZ oslo_configr
Z oslo.configZoslo_logr r_ Zs3fuser r Zs3fuse.privsepr Z_DEFAULT_LOG_DATE_FORMATr Z QUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZcontego_vault_optsrX Z
register_optsZregister_cli_optsrü ÚenvironÚflagÚargvZsetupr rY Z getLoggerr] rw r: ZloggerZsetLevelÚDEBUGÚINFOZWARNra rb r± rW rX rL rU r^ ZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetpassZgetuserr ZgetgrgidÚgetgidZgr_namer r rT rY rf rm rn ro Úobjectr r rQ r% r} r r¶ r~ rP rP rP rQ Ú<module> sÄ
#
4 h k ,