Why Gemfury?
Push, build, and install
RubyGems
npm packages
Python packages
Maven artifacts
PHP packages
Go Modules
Debian packages
RPM packages
NuGet packages
Repository URL to install this package:
|
Version:
4.1.94.5-4.1 ▾
|
python3-s3fuse-plugin
/
usr
/
lib
/
python3.6
/
site-packages
/
s3fuse
/
__pycache__
/
s3vaultfuse.cpython-36.pyc
|
|---|
3
}xb C ã O @ s d Z ddlZddlZddlZddlZddlZddlZddlmZ ddlZddl Z ddl
Z
ddl Z ddl Z ddl m
Z
ddlmZ yddlmZmZ W n$ ek
r¸ ddlmZmZ Y nX ddlmZ yddlmZmZmZ W n* ek
r ddlmZmZmZ Y nX dd l m Z ydd
l m Z W n" ek
rH dd
l m Z Y nX dd l!m"Z# dd l$m%Z% dd
l&m'Z' ddl&m(Z( dZ)dZ*dZ+dZ,e j-ddddde j-dddddgZ.e j/dd d d e j/d d d d e j/d!d d"d e j/d#dd$d%d&e j/d'e)d(d)d&e j/d*d d+d,d-e j/d.d/d0d1e j-d2dd3d4e j/d5d6d7d4g Z0e j-d8d9d:d4e j-d;dd<d4e j-d=dd>d4e j-d?dd@d4e j1dAdBdCd4gZ2e j1dDdEdFd4e j1dGdHdId4e j/dJdKdLd4e j/dMdNdOd4e j/dPdQdRd4e j/dSdTdUd4e j/dVdWdXd4e j/dYdZd[d4e j3d\d]d^d_d`dadbgdcd4e j-dddded4e j-dfddgd4e j/dhdidjd4e j/dkdidld4e j1dmddnd4gZ4e j/dodpdqd4e j/drdsdte j/dudvdsd4e j1dwe+dxd4e j1dye,dzd4e j1d{d|d}d4e j1d~dÞdd4e j1dddd4e j/dd
d dd&e j/dddd4e j/dddd4e j/dddd4e j/dddd4e j/dddd4e j/dddd4e j/dddd4e j/de% dd4e j/dddd4e j/dddd4e j/d d¡d¢d4e j/d£d¡d¤d4e j/d¥d¦d§d4e j/d¨d©dªd4e j/d«d¬dd4e j/d®d¯d°d4e j-d±dd²d4e j-d³dd´d4gZ5e j6Z6e6j7e5 e6j8e0 e6j8e2 e6j8e4 e6j8e. y e9ej:dµ Z;e6e;g W n( ek
rP e6ej<dBd
Y nX d¶e6j= ksnd¶e(j> kr|dd·l?m@Z@ n dd¸l&mAZ@ e#jBe j6e6jCjD e#jEe6jCjD ZFyre6jGjD dkrÎeFjHjIe#jJ nNe6jGjD d¹krîeFjHjIe#jK n.e6jGjD dºkreFjHjIe#jL neFjHjIe#jM W n& ek
rD eFjHjIe#j#jM Y nX ddBg d»dddddddddddddd¼
d9dddej:jNd½ej:jNd¾ej:jNd¿dddd9dddddddddg ddd9ddd9dÀdÀdÀdÀddd\&ZOdÂdÄ ZPdÀZQdÄZRejS ZTejUejV jWZXdÅZYdÆZZdÇdȄ Z[dÉdʄ Z\dËd̄ Z]G dÍd΄ dÎe^Z_G dÏdЄ dÐe_Z`G dÑd҄ dÒe^ZaG dÓdԄ dÔeZbdßdÖdׄZcdØdل ZddÚdۄ ZeefdÜkr~ee dS )àad Trilio Fuse plugin implimentation
This module is based on the vaultfuse.py module and will eventually
become the new vaultfuse.py module once integration and refactoring
of the existing vaultswift.py is complete.
Currently this module is temporary for the 2.6 release and will be merged
into a new vaultfuse.py for the next release.
é N)Údatetime)ÚThread)Úgetpwnam)ÚQueueÚEmpty)ÚLRUCache)ÚFUSEÚ FuseOSErrorÚ
Operations)Úbunchify)Úcfg)Úlog)Úget_ssl_cert_path)Úvaults3)Ú
config_parserz%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2éd é ÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarr zlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated. Please use logging_context_format_string and logging_default_format_string instead.)r r r zlog-date-formatZ DATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)r Údeprecated_namer zlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)r r z
use-syslogzUse syslog for logging.)r r zsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTz Log output to standard errorZ use_journalz%Enable Systemd native journal supportZ use_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_bursté z Burst limitZlog_rotate_intervalé z0Interval, number of hours, of log rate limiting.Zmax_logfile_counté< z Number of log files to retain.Zlog_rotate_interval_typeZHoursz Units of log rotation intervalZlog_rotation_typeZintervalztype of log retentionZ logging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZ logging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levelsz amqplib=WARNzsqlalchemy=WARNz boto=WARNz suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Úvault_storage_typeÚs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)r Úvault_data_directory_oldz/var/triliovaultÚ queue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_counté z(The number of times we retry on failuresÚvault_segment_sizeé i z vault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileÚvault_s3_auth_versionÚDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚ z S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez S3 RegionÚvault_s3_bucketz S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚ vault_s3_sslÚFalsezEnable SSL certificateÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionr zS3 signature version to useÚvault_s3_read_timeoutZ30z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolÚTruezEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Úvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).Ú vault_s3_max_pool_connectionsÚ500z>The maximum number of connections to keep in a connection poolÚbucket_object_lockz#S3 bucket object locking is enabledÚuse_manifest_suffixzyTo preserve backward compatibility, set this to False.When set to False, s3fuse creates manifest file nameswithout suffixZFLAGZs3fuse_sys_admin)Úfs)ÚutilsÚinfoÚwarnz1.0)
Z project_nameÚ region_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ tenant_idZ service_typeZ
project_idZ
auth_tokenZproject_domain_nameZ OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_tor ÚheaderÚ auth_versionÚ
os_optionsZssl_compressionZos_storage_urlZ os_usernameZ os_passwordZ os_cacertZos_certZos_keyZos_tenant_nameZ os_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclr@ ZretriesZ write_aclÚmetar Zuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚ object_namec C s t jj dkstt jdks tdtd< t jtd< t jtd< t jtd< t j td< t j
td < t j td
< t j td < t j
td < d
td< dtd< t jrt jtd d< t jr°t jtd d< t jj dkrØtjdt j d
td< n&t jj dkrþtjjt jrþt jtd< d S )Nr r* z1.0rG rI rJ ZbucketZ s3_signatureZs3_read_timeoutr: r< r= r, Z s3_ssl_certZ
GOVERNANCEZretention_moderH rC rB ZfalsezcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connectionÚtrue)ÚCONFr ÚlowerÚAssertionErrorr) Úoptionsr+ r- r/ r4 r5 r: r< r= r0 r. r1 ÚLOGrA r3 ÚosÚpathÚexists© rW rW ú!/usr/lib/python3.6/s3vaultfuse.pyÚ
option_config s2
rY é z
%016x.%08xiè c s t j fdd}|S )Nc s~ yt j jt j W n$ tk
r6 t j jt j j Y nX | |}yt j jt j W n$ tk
rx t j jt j j Y nX |S )N)ÚloggingÚdisableÚERRORÚ
BaseExceptionZNOTSET)ÚargsÚkwargsÚresult)ÚfuncrW rX Úwrapper» s
z disable_logging.<locals>.wrapper)Ú functoolsÚwraps)rb rc rW )rb rX Údisable_loggingº s rf c C sV t jj| \}}d}x8|dkrL|dkr6t jj||}n|}t jj|\}}qW ||fS )Nr, ú/)r, rg )rT rU ÚsplitÚjoin)rU ÚheadÚtailÚprefixrW rW rX Úsplit_head_tailÊ s
rm c C s t jj| \}}|S )N)rT rU rh )rU rj rk rW rW rX Úget_head× s rn c @ s e Zd Zdd Zdd Zdd Zdd Zd d
Zd d Zd
d Z dd Z
d ddZ d ddZ dd Z
dd Zdd Zd d ZdS ) ÚObjectRepositoryc K s
|| _ d S )N)Úroot)Úselfrp r` rW rW rX Ú__init__Ý s zObjectRepository.__init__c C s. |j dr|dd
}tjjt|}| j|S )Nrg r )Ú
startswithrT rU ri Ú_SEGMENT_PREFIXÚ
_full_path)rq ÚpartialrU rW rW rX Ú_full_segment_pathá s
z#ObjectRepository._full_segment_pathc C s* |j dr|dd
}tjj| j|}|S )Nrg r )rs rT rU ri rp )rq rv rU rW rW rX ru è s
zObjectRepository._full_pathc C s d S )NrW )rq rM ÚflagsrW rW rX Ú object_openî s z ObjectRepository.object_openc C s d S )NrW )rq rM ÚoffÚbufÚfhrW rW rX Ú
object_uploadñ s z ObjectRepository.object_uploadc C s d S )NrW )rq rM Úoffsetr| rW rW rX Úobject_downloadô s z ObjectRepository.object_downloadc C s d S )NrW )rq rM rW rW rX Ú
object_delete÷ s z ObjectRepository.object_deletec C s d S )NrW )rq rM r| rW rW rX Ú object_closeú s z ObjectRepository.object_closeNc C s d S )NrW )rq rM Úlengthr| rW rW rX Úobject_truncateý s z ObjectRepository.object_truncatec C s d S )NrW )rq rM r| rW rW rX Úobject_getattr s z ObjectRepository.object_getattrc C s d S )NrW )rq rU r| rW rW rX Úobject_readdir s z ObjectRepository.object_readdirc C s d S )NrW )rq rU ÚmoderW rW rX Ú
object_access s z ObjectRepository.object_accessc C s d S )NrW )rq rU rW rW rX Ú
object_unlink s z ObjectRepository.object_unlinkc C s d S )NrW )rq rU rW rW rX Ú
object_statfs s z ObjectRepository.object_statfs)N)N)Ú__name__Ú
__module__Ú __qualname__rr rw ru ry r} r r r r r r
r r r rW rW rW rX ro Ü s
ro c s e Zd Z fddZG dd deZG dd dZdd Zd d
Zd d Z d
d Z
dd Z i fddZ dd Z
dd Zdd Zdd Zdd Zd d Zd d Zd!d" Zed#d$ Zd%d& ZdYd(d)Zd*d+ Zd,d- Zd.d/ Zd0d1 Z dZd2d3Z d4d5 Z d6d7 Z d8d9 Z d:d; Z!d<d= Z"d>d? Z#d@dA Z$d[dCdDZ%dEdF Z&d\dGdHZ'dIdJ Z(dKdL Z)dMdN Z*dOdP Z+dQdR Z,dSdT Z-d]dUdVZ.dWdX Z/ Z0S )^ÚBackendRepositoryc sr t t| j|f| ttj| _ttj| _i | _ t
j t | _
i | _tj | _i | _i | _i | _| jdt | _d S )Nr )Úsuperr rr r Ú FUSE_USERÚpw_uidrD Úpw_gidÚgroup_idÚmanifestr Ú S3BackendrR Ú_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ threadingÚLockÚ#_BackendRepository__open_close_lockÚ_BackendRepository__in_openÚ _BackendRepository__worker_poolÚ _BackendRepository__pending_iosÚBackendWorkerPoolÚ,_BackendRepository__object_open_backend_pool)rq rp r` )Ú __class__rW rX rr s
zBackendRepository.__init__c @ s0 e Zd ZdZdd Zdd Zdd Zdd Zd
S ) z BackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
c C s8 t j| tj|| _|| _tj | _d| _ | j
d S )NT) r rr r r Ú_BackendWorker__backendÚ_BackendWorker__job_queuer ZEventÚ _stop_eventZdaemonÚstart)rq Ú job_queuerR rW rW rX rr 3 s
z(BackendRepository.BackendWorker.__init__c C s | j j d S )N)r¢ Úset)rq rW rW rX Ústop= s z$BackendRepository.BackendWorker.stopc C s
| j j S )N)r¢ Zis_set)rq rW rW rX Ústopped@ s z'BackendRepository.BackendWorker.stoppedc C s¤ t jdtj j x| j sy<| jjdd\}}}z|| jf|| W d| jj X W q t
k
rp wY q t k
r } zt j | W Y dd}~X qX qW dS )zO Start up the worker and block until there is an item in the queue
zStarting worker thread[%x].Tr N)
rS r@ r Úcurrent_threadÚidentr§ r¡ Úgetr Z task_doner Ú ExceptionÚ exception)rq rb r_ ÚkargsÚerW rW rX ÚrunC s
z#BackendRepository.BackendWorker.runN)r r r Ú__doc__rr r¦ r§ r¯ rW rW rW rX Ú
BackendWorker/ s
r± c @ s8 e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd S )
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
c C s> t tj| _g | _x&t|D ]}| jjtj| j| q W d S )N) r rO r# r¤ ÚworkersÚrangeÚappendr r± )rq Z num_threadsrR Ú_rW rW rX rr \ s
z,BackendRepository.BackendWorkerPool.__init__c C s4 x| j D ] }|j qW x| j D ] }|j q W d S )N)r² r¦ ri )rq ÚtrW rW rX Ú__del__d s z+BackendRepository.BackendWorkerPool.__del__c O s | j j|||f dS )z+ Add a job to the worker queue
N)r¤ Zput)rq rb r_ r rW rW rX Úadd_jobk s z+BackendRepository.BackendWorkerPool.add_jobc C s x|D ]}| j || qW dS )z4 Add a list of jobs to the worker queue
N)r¸ )rq rb Z args_listr_ rW rW rX Úmapp s
z'BackendRepository.BackendWorkerPool.mapc C s | j j dS )z> Wait for completion of all the jobs in the queue
N)r¤ ri )rq rW rW rX Úwait_completionv s z3BackendRepository.BackendWorkerPool.wait_completionN) r r r r° rr r· r¸ r¹ rº rW rW rW rX r X s r c C sV t jj|\}}d}x8|dkrL|dkr6t jj||}n|}t jj|\}}qW ||fS )Nr, rg )r, rg )rT rU rh ri )rq rU rj rk rl rW rW rX rm { s
z!BackendRepository.split_head_tailc C s t jj|\}}|S )N)rT rU rh )rq rU rj rk rW rW rX Ú _get_head s zBackendRepository._get_headc C s. |j dr|dd
}tjjt|}| j|S )Nrg r )rs rT rU ri rt Ú
_get_cache)rq rv rU rW rW rX Ú_get_segment_cache s
z$BackendRepository._get_segment_cachec C s* |j dr|dd
}tjj| j|}|S )Nrg r )rs rT rU ri rp )rq rv rU rW rW rX r¼ s
z BackendRepository._get_cachec C s6 | j |\}}tj }||d< t|}| jj|}|S )NrM )rm rR Úcopyr r Zget_object_manifest)rq rM Ú containerrl Ú_optsr rW rW rX Ú_read_object_manifest s z'BackendRepository._read_object_manifestc
C sh | j |\}}i }d|d< tj }||d< x |j D ]\}} | |d| < q4W t|}| jj||| d S )NrN zx-static-large-objectrM zx-object-meta-)rm rR r¾ Úitemsr r Zupload_object_manifest)
rq rM Úobject_manifestÚmetadatar¿ rl Z put_headersrÀ rJ ÚvaluerW rW rX Ú_write_object_manifest s
z(BackendRepository._write_object_manifestc C sB t jd| tj }t|}t|jdd g}| jj|| d S )Nz mkdir, %srg z -segments) rS r rR r¾ r rt Úlstripr Ú mkdir_object)rq rM rÀ r_ rW rW rX Ú_create_segments_folder° s
z)BackendRepository._create_segments_folderc
C sÒ | j |\}}tj }|dkr$g }n|g}d |d< d|d< d|d< d|d< d |d< t|}|dkrv||d< |j| nd }| jj||}i }x@|d d j D ],\}} d
|krÂ| ||jd
d < q| ||< qW |S ) Nr, Ú delimiterFÚhumanÚtotalsÚlongrl ÚheadersZMetadatazx-object-meta-r ) rm rR r¾ r r´ r Ú stat_objectr rh )
rq rM r¿ rl rÀ r_ ÚstrÄ rJ rÅ rW rW rX Ú_get_object_metadata¸ s, z&BackendRepository._get_object_metadatac h C sÖ | j |\}}| j|}|tdd@ tjk}| j8 | jj|tj | j
j|d | j
| d7 < W d Q R X | j| P | j j|i | j j|i || j
kr¤|tdd@ tjksÜ|tj@ tjksÜ|tj@ tjkr*y| j|}W n8 tk
r" tjd| tjd | j|}Y nX di i| j
|< x^|D ]V}|d jd d } | jd
d } t| d}
|jd d |d < d
|d< || j
| |
< q8W | j|} | j
| j| y&| j| j
| d } tj| dd W n tk
rè Y nX tjtj j |dd t |d}
|
j t j!| W d Q R X nztjtj j |dd |tj"@ tj"krªy| j#| W n tk
rv Y nX yt |d}
W d Q R X W n tk
r¨ Y nX y | j$|d } tj| dd W n tk
rà Y nX tj ||}zN| j%| | j&| j | |< di i| j
|< dd
i| j
| d |< | j'|| W d | j | j(|d | j
| d j(|d tj)| X yt |d}
W d Q R X W n tk
r¢ Y nX y ddl*m+} ||j, W n tk
rÖ Y nX tj ||}z¼yBd|i| j
| d |< | j-t.j/t0| j | |< t1 | j | |< |S tk
r } zVtj2| | j | j(|d | j
| d j(|d | j | j(|d tj)| W Y d d }~X nX W d | j | j
| d8 < W d Q R X X W d Q R X d S )NZffé r r z+Manifest for %s not found. Trying in 5 secsr Ú open_handlesÚnamez
-segments/Ú.Ú versionIdr, FÚmodifiedz segments-dirT)Úexist_okÚwz -segmentsÚreadonly)ÚPath)3rm ru ÚintrT ÚO_RDONLYr r Ú
setdefaultr ÚRLockr r r r ÚO_RDWRÚO_APPENDrÁ r« rS r@ ÚtimeÚsleeprh rª rÑ ÚupdateÚmakedirsr^ rU ÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_WRONLYr rw rÉ r Ú
_object_closeÚpopÚcloseZpathlibrÛ Ztouchr rO r$ rR r¥ r¬ )rq rM rx r¿ rl Ú full_pathrÚ r ÚsegZoffstrr~ rÄ Z segment_dirÚfr| rÛ ÚexrW rW rX ry ô sÂ
z BackendRepository.object_openc C sR y t j }t|}|j|| W n, tk
rL } ztj| W Y dd}~X nX dS )zý Utility method to be dispatched to a worker
thread in order to clean up old segments.
Args:
backend (class instance): Instance of the backend plugin.
segment_list (list): List of segments to remove.
N)rR r¾ r Údelete_object_listr« rS r¬ )rq ÚbackendÚ segment_listrÀ rò rW rW rX Z__purge_old_segments_task s z+BackendRepository.__purge_old_segments_taskc C sÖ | j | | j | j| ® yv| j| jddt | d }| j|\}}g }d}| j| d | d sd}d} d}
x@|| j| krP y | j| j| | d |} W n8 tk
ræ t j
d | j| j| | d |} Y nX | j| | d r>t | } t | j
tj}
|j| j| | d | j| j|
| jd
nd| j| | d }
|j| j| | d | j| | jd d
| j| | d |
| j| | d d
|tj7 }|d7 }| |
7 } qW | j|||t|t| dd d}x°dr|r| j|||}
t|
dkrP t|
}
y| j| | d }W n d
}Y nX |jd}tt|
t|g }t|dkr| j | | j | j | |tj7 }qæW dS t k
rÆ } zt j | W Y dd}~X nX W dQ R X dS )zé Handle object_close by updating the manifest.
Waits for all of the background jobs to complete prior to updating
manifest using the main thread. Also queues up tasks to clean up
any old segments.
z segments-dirrg z -segmentsr rÓ rÚ rÔ r r× )rU rÖ ÚetagÚ
size_bytesÚ content_typer÷ rÖ r, Úhashrø r )z segments-dirz
segment-countz
total-size)rÄ TN)!r rº r r rª rt rm r r^ râ rã r ÚminÚst_sizerO r& r´ Ú
version_idrö rø rÆ Ústrrõ ÚlenÚsortedÚstripÚlistr¥ r¸ Ú+_BackendRepository__purge_old_segments_taskr« rS r¬ )rq rM r| Ú segments_dirr¿ rl rà Zsegmentsr~ Z
total_sizeÚ segment_sizerÐ ÚstatZobjectsÚpZ
purge_listrò rW rW rX rì s
z BackendRepository._object_closec ! C s8 | j | " | j|| | j| j| | j| j| | j| d j| ytj| W n tk
rp Y nX t | j| d dkròyH| jj|d }|d ks¤t
| jj|d }|d ks¾t
tj | j | W n tk
rä Y nX | jj| | j
, | j| s || jkr | j j|d W d Q R X W d Q R X d S )NrÓ r )r rì r rí r r rT rî r^ rþ rQ Úremoveru r r )rq rM r| ZohZpiosrW rW rX r
s. z BackendRepository.object_closec
C s~ | j | h y|| j| krJ| j| | d dkrJ| j| | d }n8| j||}| j| jddt | d }tjj||}tj }d| j| k|d< | j
|\} }
t ||d < |
j d|d
< t
|}| ||d g} | j| | j| | j| | j| j| ||||| W n\ tk
rn } z>tj| || j| | ksHt| j| | j| W Y d d } ~ X nX W d Q R X d S ) Nr× TrÔ z segments-dirrg z -segmentsÚ0Ú
path_validr rM )r r Ú,_BackendRepository__next_segname_from_offsetrª rt rT rU ri rR r¾ rm rþ Úrstripr r Úaddr r¸ Ú&_BackendRepository__object_upload_taskr« rS r¬ rQ r )
rq rM r~ r{ r| Ú seg_fullnameZsegnamer rÀ r¿ ÚobjÚargs1rò rW rW rX r} ' s8
z BackendRepository.object_uploadc $ C s t jd||tj jf |d }|d } |dd
}| j| || j| | ksXtW dQ R X yd|_|j ||| |}
W nn t
k
rê } zRt j | | j| 0 || j| | ksºt| j| | j | W dQ R X W Y dd} ~ X nX | j| || j
| kri | j
| |< || j
| | d< d| j
| | d< |
jdd | j
| | d
< || j| | kslt| j| | j | W dQ R X dS ) zP Method run by a worker in the thread pool to upload an object segment.
z6Object [%s] segment [%s] upload running in thread[%x].r r% NTrÔ r× Ú VersionIdr, rÖ )rS r@ r r¨ r© r r rQ r Z
put_objectr« r¬ r r rª ) rq rô r rÀ rM r~ r r| r{ Zbuf_lenZresprò rW rW rX Z__object_upload_taskN s2
z&BackendRepository.__object_upload_taskc C s
xzt jd | j| \ || j| | kr,w|| j| krZtd|tt|tdf | j| | d }P W d Q R X qW | j|j d\}}i }| j| | j
dd|d< t |}||g}y| j j
||} t| S tk
r }
ztj|
W Y d d }
~
X nX d S ) Ng¹?zobject %s not found r rÔ rg rÖ r, rü )râ rã r r r r« ÚSEGMENT_FORMATrÜ rm r rª r r Z
get_objectÚ bytearrayrS r¬ ) rq rM r~ r| r r¿ r rÀ r r{ rò rW rW rX r s s.
z!BackendRepository.object_downloadc C sª | j j|tj | j | | j|\}}tj }t|}|g}|dkr\|dkr\|j| y| j j
|| W n, t k
r } zt j
| W Y d d }~X nX W d Q R X d S )Nr, rg )r rÞ r rß rm rR r¾ r r´ r Z
delete_objectr« rS r¬ )rq rM r¿ r rÀ r rò rW rW rX r s
z BackendRepository.object_deleteNc C s& |rd S | j |tj}| j|| d S )N)ry rT rë r )rq rM r r| rW rW rX r ¤ s z!BackendRepository.object_truncatec C sp t j }d |d< d|d< d|d< d|d< tjj|dt| |d< g }|dkrTg }n|g}t|}| jj||S ) NrÊ FrË rÌ rÍ z%016xrl r, ) rR r¾ rT rU ri rÜ r r Z
list_segments)rq r¿ r r~ rÀ r_ rW rW rX rõ ª s z BackendRepository.segment_listc C sÀ | j |\}}| j| jdd }|rT|jdt r@| j |\}}| j |\}}|}n|d }| j|||}t|dkrtt|tdf S tt|tt |d j
|d j
dd dd f S ) Nz segments-dirrg z -segmentsr r rÕ rÒ éÿÿÿÿ) rm r rª rs rt rõ rþ r rÜ rÿ rh ) rq rU r~ r¿ rl r Úcr ÚfilesrW rW rX Z__next_segname_from_offset¼ s $z,BackendRepository.__next_segname_from_offsetc
C sò | j | | j|\}}| jj|d rV|| j| krV| j| | d }|jdd S | j| jdd }|r| j|\}}|}n|d }| j|||} W d Q R X t| dkrÀtt|tdf S tt|tt | d j|d jdd df S )
NrÔ z
-segments/r z segments-dirz -segmentsr rÕ rÒ r )
r rm r rª rh rõ rþ r rÜ rÿ )
rq rU r~ r¿ rl rð r r r r rW rW rX Úcurr_segname_from_offsetÑ s z*BackendRepository.curr_segname_from_offsetc s t jj|r~y@t j| t fdddD }d |d < t|d d |d
< |S tk
rx } ztj| W Y dd}~X nX dS dS )aë Utility to check the tmpfs cache and return stat() from that.
This method looks to see if the object (directory) exists in the
local cache and will perform a stat() locally instead of calling
all the way to the backend.
Args:
object_cache_path (str): Cache path to the object we
need stat infor on.
Returns:
Dictionary of stat() information or None if object does not exist.
c 3 s | ]}|t |fV qd S )N)Úgetattr)Ú.0rJ )rÐ rW rX ú <genexpr>ý s z0BackendRepository._stat_cache.<locals>.<genexpr>Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkrû Úst_uidi Ú
st_blksizeÚ st_blocksN)r r r r r r rû r! ) rT rU ÚisdirÚlstatÚdictrÜ r« rS r¬ )rq Zobject_cache_pathÚ stat_infor® rW )rÐ rX Ú _stat_cacheê s(
z BackendRepository._stat_cachec sf | j |}| j|}|d k r |S | j|\}}tj }|dkrDg }n|g}d |d< d|d< d|d< d|d< d |d< t|}i }|dkr||d< |j| nd }y`| jj|| | j |d< | j
|d < d
j d d|d < d
j d
d|d< d
j dd|d< t d |d< t d |d< t d |d< d|d< d|d< |d k r\d|kr\d|d< t d |d < |d d kr|dksÂ|d d kr|d ksÂ|d d kr´|dks d d krþd |d< d!|d < d"|d< | j
|} tjj| sþtj| d# W nD tk
rD }
z&tj| t fd$d%d)D }W Y d d }
~
X nX d&|d'< t |d d& |d(< |S )*Nr, rÊ FrË rÌ rÍ rl r r! rÎ ZETagrö r rü Z ContentTyperø Z timestampr r r r r ií r Zauthorized_keyi Úsizerû r Z directoryTé i iýA ié c 3 s | ]}|t |fV qd S )N)r )r rJ )rÐ rW rX r O s z3BackendRepository.object_getattr.<locals>.<genexpr>i r" r# )r r r r r r rû r! )ru r( rm rR r¾ r r´ r rÏ r rD rª rÜ r¼ rT rU rV Úmkdirr« r% r& ) rq rM r| rï r r¿ rl rÀ r_ Zcontainer_pathrò rW )rÐ rX r sx
z BackendRepository.object_getattrc C s yt j|d}W n. tk
r> } ztj| W Y d d }~X nX d}x|| j| krÈy | jj| j| | d | W n: tk
r® t j
d | jj| j| | d | Y nX || j| | d 7 }qFW y| jj || W n. tk
r
t j
d | jj || Y nX d S )Nz%Y-%m-%dT%H:%M:%Sr rÔ r r÷ ) r Zstrptimer« rS r¬ r r Z put_object_segment_retentionr^ râ rã Zput_manifest_retention)rq rM Ú retainuntilÚdtrò r~ rW rW rX Ú_set_object_retentionc s(
z'BackendRepository._set_object_retentionc C s | j |tj}zîyº| j| ¦ tj| j| }d}x8|| j| krj| j| | d }|j|d ||7 }q4W |jdd |dkr| j||j d n |j d||< | j
j || || j| |< W d Q R X W n. t k
rø } zt
j| W Y d d }~X nX W d | j|| X d S )Nr r÷ rÓ r, Úutf8zutf-8)ry rT rÝ r r¾ Údeepcopyr rí r. Údecoder Úupdate_object_attributesr« rS r¬ r ) rq rM rÔ rÅ r| Úattrsr~ r) rò rW rW rX Úobject_setxattr s*
z!BackendRepository.object_setxattrc C s¸ | j |tj}zyb| j| N tj| j| }|j|d |jdd | jj || | j| j|d W d Q R X W n. t
k
r } zt j | W Y d d }~X nX W d | j
|| X d S )NrÓ )ry rT rÝ r r¾ r0 r rí r r2 r« rS r¬ r )rq rM rÔ r| r3 rò rW rW rX Úobject_removexattr s
z$BackendRepository.object_removexattrc C s | j |tj}zpy<| j| ( tj| j| }|jd |j }|S Q R X W n. t k
rz } zt
j | W Y d d }~X nX W d | j || X d S )NrÓ )
ry rT rÝ r r¾ r0 r rí Úkeysr« rS r¬ r )rq rM r| r3 r6 rò rW rW rX Úobject_listxattrª s
z"BackendRepository.object_listxattrc C s | j |tj}z^y*| j| t| j| | dS Q R X W n. tk
rh } ztj| W Y d d }~X nX W d | j || X d S )Nzutf-8)
ry rT rÝ r Úbytesr r« rS r¬ r )rq rM rÔ r| rò rW rW rX Úobject_getxattr¹ s
z!BackendRepository.object_getxattrc c sd g }|j dd }g }|| jj|7 }x |D ]}|j|jdd q,W xt|D ]
}|V qRW d S )Nrg r r )r r Ú list_objectsr´ rh r )rq rM r| ZlistingZdir_pathÚdirentsZlstÚrrW rW rX r
Ä s
z BackendRepository.object_readdirc C s d S )NrW )rq rM r rW rW rX r Ï s z BackendRepository.object_accessFc C s$ |t d< t j }t|}|sày| j|}| j|}g }x|D ]}|j|d q<W | jj|| |jd}|d k r°|g} | jj | | yt
j | j | W n t
k
r® Y nX W n, tk
rÞ }
ztj|
W Y d d }
~
X nX y| jj| W n. tk
r }
ztj|
W Y d d }
~
X nX d S )NrL rÔ z segments-dir)rR r¾ r rÁ rÑ r´ r ró rª Ú rmdir_objectrT Úrmdirr¼ r^ r« rS r¬ Zdelete_object_manifest) rq rM rL rÀ Z obj_manifestZ obj_metadatarõ Úmanr r_ rò rW rW rX r Ò s6
z BackendRepository.object_unlinkc C sÐ t j }t|}g }y| jj||}W n6 tk
r\ } ztj| tt j
W Y d d }~X nX d|d krt |d }t |d t |d }nd }t |d }i }||d< ||d< ||d< d |d
< d |d < |S )
Nzx-account-meta-quota-bytesrÎ zx-account-bytes-usedr r) Úf_blocksÚf_bfreeÚf_bavailr Úf_favailÚf_frsizer ) rR r¾ r r rÏ r« rS r¬ r ÚerrnoÚENOENTrÜ ) rq rM rÀ r Zstvrò r@ rB r- rW rW rX r ñ s*
z BackendRepository.object_statfsc
C sÚ t jd| | j|\}}tj }t|}||g}y| jj|| W n* tk
rp } zt j | dS d }~X nX | j
|} |dkr| j
t j j
||} yt j| | W n, tk
rÔ } zt j | W Y d d }~X nX dS )Nz mkdir, %sr F)rS r rm rR r¾ r r rÈ r« r¬ r¼ rT rU ri rå )
rq rU r Zistr¿ r rÀ r_ rò Ú
cache_pathrW rW rX r+ s$
zBackendRepository.mkdirc K C s | j |\}}tj }d |d< t|}|jdd }g }y|| jj|dd7 }W n, tk
r| } ztj | W Y d d }~X nX t
|dkrt t j
y| jj|jdg| W n, tk
rÚ } ztj | W Y d d }~X nX tjjt|jd}y|| jj|dd7 }W n. tk
r6 } ztj | W Y d d }~X nX t
|dkry| jj|jdg| W n. tk
r } ztj | W Y d d }~X nX y&| j|} tjj| r´tj| W n tk
rÌ Y nX y&| j|}
tjj|
ròtj|
W n tk
r
Y nX d S )Nrl rg r% )Z max_itemsr )rm rR r¾ r r r r: r« rS r¬ rþ r rE Z ENOTEMPTYr= rT rU ri rt rÇ r½ r$ ÚshutilÚrmtreer^ r¼ ) rq rM r¿ r rÀ rU Z dir_itemsrò Zseg_pathZsegment_cache_pathrG rW rW rX r> 0 sR
zBackendRepository.rmdirc C sV t jd| y.| j|\}}| jtjj||}tj||S tk
rP Y nX d S )Nz chmod, %s) rS r rm r¼ rT rU ri Úchmodr^ )rq rU r r¿ rl rG rW rW rX rJ g s zBackendRepository.chmodc C sX t jd| y0| j|\}}| jtjj||}tj|||S tk
rR Y nX d S )Nz chown, %s) rS r rm r¼ rT rU ri Úchownr^ )rq rU ÚuidÚgidr¿ rl rG rW rW rX rK p s zBackendRepository.chownc C s t dd S )NzNot Applicable)r« )rq rÔ ÚtargetrW rW rX Úsymlinky s zBackendRepository.symlinkc
O C s | j j|d d kst| j j|d rHtjd | j j|d rHtd| tjd||f |d }y| j|dd W n, tk
r } ztj | W Y d d }~X nX yJ| j
|}| j
|}|jd|d |jd|d krê| j|dd d S W n tk
r Y nX d
}yªy| j
|}W n tk
r. Y nX | j |}|jd|d } g }
x<|D ]4} |
j | d | d | d
| jdd| d d qTW | j
||
| |d |d dd d}W n0 tk
râ } ztj | W Y d d }~X nX zêyÌ| j |} | j
|}|jd|d } g }x<| D ]4} |j | d | d | d
| jdd| d d qW | j
||| |d |d dd y| j|dd W n. tk
r® } ztj | W Y d d }~X nX W n tk
rÊ Y nX W d |ry| j|d
d W n. tk
r } ztj | W Y d d }~X nX X d S )Né z%s in use. Try againzrename, %s -> %sú~T)rL z segments-dirz -segmentsr FrÔ rù r÷ rÖ r, rø )rU rö r÷ rÖ rø z
segment-countz
total-size)z segments-dirz
segment-countz
total-size)rÄ )r rª rQ râ rã r« rS r r r¬ rÑ rÁ r´ rÆ r^ )
rq ÚoldÚnewZ newbak_namerò Z new_metadataZ old_metadataZnewfile_existsZ new_manifestr Znewbak_manifestr? Z old_manifestrW rW rX Úrename| s
zBackendRepository.renamec C sZ t jd| t|\}}| jtjj||}t|\}}| jtjj||}tj||S )Nzlink, %s)rS r rm r¼ rT rU ri Úlink)rq rN rÔ r¿ rl Zcache_path_targetZcache_path_namerW rW rX rU î s zBackendRepository.linkc C sN t jd| t|\}}| j|}ytj|| W n tk
rH dS X dS )Nz utimens, %sr )rS r rm r¼ rT Úutimer^ )rq rU Útimesr¿ rl rG rW rW rX Úutimensö s
zBackendRepository.utimensc C s dS )Nr rW )rq rU rW rW rX Údestroy s zBackendRepository.destroy)N)N)F)F)N)1r r r rr r r± r rm r» r½ r¼ rÁ rÆ rÉ rÑ ry r rì r r} r
rf r r r rõ r
r r( r r. r4 r5 r7 r9 r
r r r r+ r> rJ rK rO rT rU rX rY Ú
__classcell__rW rW )r rX r sX )# < s '%
*
O
7 r
r c @ sp e Zd Zdd Zdd ZdddZdd Zd d d Zd
d Zdd Z dd Z
dd Z dd Z dd Z
dd Zd
S ) Ú FuseCachec C sÜ || _ || _i | _tj | _ttj| _ ttj
| _ t j
j| j sy4tj| j tj| j t| j d t| j g W qØ tk
r Y qØX nHt j| j }|j| j ks´|j| j krØtjtjt| j d t| j g d S )Nú:)rp Ú
repositoryÚlrucacher r Ú
lrucache_lockr r r rD r r rT rU r$ r> r+ rK rý r^ r r! r rO r" )rq rp r] r' rW rW rX rr s$
zFuseCache.__init__c C sx | j j||}| jZ | jj|i | j| j|d }|d ksBt| j| j|ttj dt
j |t d W d Q R X |S )N)Úmaxsize)r^ ÚlrulockrM Ú writes_before_update_manifest)
r] ry r_ r^ rÞ rí rQ r rO r( r r ÚNUMBER_UPLOADS_BEFORE_FLUSH)rq rM rx r| ÚitemrW rW rX ry 3 s
zFuseCache.object_openTc C s² t jd|tj jf | j| | }|d |ks6t|d }|d P y4x.|j \}}|d rL| jj |||d | qLW W n t
k
r Y nX W d Q R X |r®| jj || d S )Nz Cache object_flush [%s] [%x]rM r^ ra r× Údata) rS r r r¨ r© r^ rQ Úpopitemr] r} ÚKeyErrorrì )rq rM r| Úupdate_manifestrd Úcacherz rW rW rX Ú object_flushC s"
zFuseCache.object_flushc
C sz t jd|tj jf | j||dd | j4 | j| j|d t | j| s^| jj|d W d Q R X | j
j || d S )Nz Cache object_close [%s] [%x]F)rh ) rS r r r¨ r© rj r_ r^ rí rþ r] r )rq rM r| rW rW rX r Z s zFuseCache.object_closeNc C s | j j||| d S )N)r] r )rq rM r r| rW rW rX r g s zFuseCache.object_truncatec c sV xP|dkrP|t j t j }|| }t|t j| }|||fV ||7 }||8 }qW d S )Nr )rO r& rú )rq r~ r Z
seg_offsetÚbaseÚseg_lenrW rW rX Ú_walk_segmentsj s
zFuseCache._walk_segmentsc ! C s® | j | | d |kstt }| j | | d l xb| j||D ]P\}}}y | j | | d | d } W n tk
r yÌ| j | | d }
t|
tjkr"|
j \} } | d r"| j j
|| | d | | j | | d d8 < | j | | d s"| j j || t | j | | d< | j j
|||} d| d | j | | d |< W n, tk
r| }
ztj|
d
S d }
~
X nX Y nX || |||
7 }qFW W d Q R X t|S ) NrM ra r^ re r× rb r F)r× re r )r^ rQ r rm r^ rþ rO r( rf r] r} rì rc r r« rS r¬ r8 )rq rM r r~ r| Z
output_bufÚ segoffsetrk rl Úsegdatari rz rd rò rW rW rX Ú object_readu sB
"zFuseCache.object_readc C sô t jd|tj jf t|}| j| | d |ks:td}| j| | d x| j||D ]x\}}} | j| | d }
||
krzt|
t j
kr|
j \} } | d r| j j
|| | d | | j| | d d 8 < | j| | d s| j j|| t| j| | d< y4| j j|||}
|
d kr:td
d |
d |
|< W n, tk
rv td }
d
|
d |
|< Y nX n |
| d }
t|
|k r®|
jd|| t|
||||
|
|||
< d
|
| d< || 7 }qdW W d Q R X t|S )Nz Cache object_write [%s] [%x]rM r ra r^ r× re rb r zObject not foundF)r× re Tó )rS r r r¨ r© rþ r^ rQ rm rO r( rf r] r} rì rc r r« r^ r Úextend)rq rM r{ r~ r| r Zbufptrrn rk rl ri rz rd ro rW rW rX Ú object_write° sN
zFuseCache.object_writec C s t j| jj||S )N)rT r+ r] ru )rq rU r rW rW rX r+ s zFuseCache.mkdirc C s | j j|}tj|S )N)r] ru rT r> )rq rU rï rW rW rX r> s zFuseCache.rmdirc C s | j j|}tj||S )N)r] ru rT rJ )rq rU r rï rW rW rX rJ s zFuseCache.chmodc C s | j j|}tj|||S )N)r] ru rT rK )rq rU rL rM rï rW rW rX rK s zFuseCache.chown)T)N)r r r rr ry rj r r rm rp rs r+ r> rJ rK rW rW rW rX r[ s
;Tr[ c @ sú e Zd Zd:ddZdd Zdd Zdd Zed;d
d Zd d
Z dd Z
dd Z dd Z dd Z
dd Zdd Zdd Zd d Zd d Zd d! Zd"d# Zd$d% Zd&d' Zd<d(d)Zd*d+ Zd=d,d-Zd.d/ Zd0d1 Zd>d2d3Z d4d5 Z d6d7 Z d8d9 Z dS )?Ú TrilioVaultNc C s& || _ |pt|| _t|| j| _d S )N)rp r r] r[ ri )rq rp r] rW rW rX rr s zTrilioVault.__init__c C s | j j|| d S )N)r] r )rq rU r rW rW rX Úaccess s zTrilioVault.accessc C s | j j||S )N)r] rJ )rq rU r rW rW rX rJ s zTrilioVault.chmodc C s | j j|||S )N)r] rK )rq rU rL rM rW rW rX rK # s zTrilioVault.chownc C s | j j||S )N)r] r )rq rU r| rW rW rX r & s zTrilioVault.getattrc C s | j j|||S )N)r] r4 )rq rU rÔ rÅ r) rW rW rX Úsetxattr* s zTrilioVault.setxattrc C s, |j ds|j dr tddS | jj||S )NZsecurityÚsystemr, zutf-8)rs r8 r] r9 )rq rU rÔ rW rW rX Úgetxattr- s
zTrilioVault.getxattrc C s | j j|S )N)r] r7 )rq rU rW rW rX Ú listxattr2 s zTrilioVault.listxattrc C s | j j||S )N)r] r5 )rq rU rÔ rW rW rX Ú removexattr5 s zTrilioVault.removexattrc c s4 ddg}|j | jj|| x|D ]
}|V q"W d S )NrÕ z..)rr r] r
)rq rU r| r; r< rW rW rX Úreaddir8 s
zTrilioVault.readdirc C s2 t j| j|}|jdr*t jj|| jS |S d S )Nrg )rT Úreadlinkru rs rU Úrelpathrp )rq rU ÚpathnamerW rW rX r| > s
zTrilioVault.readlinkc C s t j| jj|||S )N)rT Úmknodr] ru )rq rU r ZdevrW rW rX r P s zTrilioVault.mknodc C s | j j|S )N)r] r> )rq rU rW rW rX r> S s zTrilioVault.rmdirc C s | j j||S )N)r] r+ )rq rU r rW rW rX r+ V s zTrilioVault.mkdirc C s | j j|S )N)r] r )rq rU rW rW rX ÚstatfsY s zTrilioVault.statfsc C s | j j|S )N)r] r )rq rU rW rW rX Úunlink\ s zTrilioVault.unlinkc C s | j j||S )N)r] rO )rq rÔ rN rW rW rX rO _ s zTrilioVault.symlinkc C s | j j||S )N)r] rT )rq rR rS rW rW rX rT b s zTrilioVault.renamec C s | j j||S )N)r] rU )rq rN rÔ rW rW rX rU e s zTrilioVault.linkc C s | j j||S )N)r] rX )rq rU rW rW rW rX rX h s zTrilioVault.utimensc C s | j j||S )N)ri ry )rq rU r rW rW rX rç n s zTrilioVault.openc C s | j |tjS )N)rç rT ÚO_CREAT)rq rU r ZfirW rW rX Úcreateq s zTrilioVault.createc C s | j j||||}|S )N)ri rp )rq rU r r~ r| r{ rW rW rX Úreadt s zTrilioVault.readc C s | j j||||S )N)ri rs )rq rU r{ r~ r| rW rW rX rè x s zTrilioVault.writec C s | j j|||d d S )N)r| )ri r )rq rU r r| rW rW rX Útruncate{ s zTrilioVault.truncatec C s | j j|| d S )N)ri rj )rq rU r| rW rW rX Úflush~ s zTrilioVault.flushc C s | j j|| d S )N)ri r )rq rU r| rW rW rX Úrelease s zTrilioVault.releasec C s t jd| | jj|S )Nz destroy, %s)rS r r] rY )rq rU rW rW rX rY s zTrilioVault.destroy)N)N)N)N)N) r r r rr ru rJ rK rf r rv rx ry rz r{ r| r r> r+ r r rO rT rU rX rç r r rè r
r r rY rW rW rW rX rt s:
rt ú/etc/fuse.confc C sÐ d}t jj| rJt| d*}x"|D ]}d|kr"d|kr"d}P q"W W d Q R X |dkrÌd}t jj| rt| d}|j d d }W d Q R X td d
}|j| W d Q R X tjd | tjd tj d d g d S )
Nr r< Zuser_allow_otherú#r zuser_allow_other
ZrtÚ
z/tmp/fuse.conf.tmpZwtz/etc/fuse.confz root:root)
rT rU rV rç r rè r> r¾ r rK )Z conf_fileÚfoundrñ ÚlineÚsZoutfrW rW rX Ú fuse_conf s"
r c C sR yÌyt j| dg W n tk
r( Y nX tjj| rtj| }ttj }tt
j }|j |kof|j
|ksÊt j| dtd t
g nHt j| dg t j|dg t j| td t
g t j|td t
g W n, tk
rø } ztj| W Y d d }~X nX dd tjtjD t|t|d}d}tjj d kr8d
}t|| |ddddd d S ) Nz-lz-Rr\ z-pc S s& g | ] }t jtjjtj|d dqS )T)Ú
ignore_errors)rH rI rT rU ri rO r" )r ÚxrW rW rX ú
<listcomp>» s zmain.<locals>.<listcomp>)r] TrN F)Z nothreadsZ
foregroundZnonemptyZ
big_writesZ allow_other)r> Zumountr^ rT rU r$ r r r r Ú
FUSE_GROUPr r! r rK r+ r« rS r¬ ÚlistdirrO r" rt r r7 rP r )Z
mountpointZ cacherootZmountpoint_statrD r rò Z tvaultpluginZdisable_fuse_threadsrW rW rX Úmain¡ sB
r c C sL t tjtjkstt tjt} | j t | j
t t tj tj
dS )z$Main routine that drives fuse mount.N)rY rO r# r$ rQ r r r rR Zvalidate_s3_clientZset_retention_moder r! r" )Z s3backendrW rW rX r¯ Ó s
r¯ Ú__main__i i )r )gr° rT ZgrpÚsysrE râ Zgetpassr r¾ ré rH rd r r Úpwdr r r Ú ImportErrorZqueueZ
cachetoolsr Zfuser r r
r^ ZfusepyZs3fuse.bunch_p3r Z oslo_configr Z oslo.configZoslo_logr
r[ Z s3fuse.utilsr Zs3fuser r Z_DEFAULT_LOG_DATE_FORMATrt Z QUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZ
vault_optsrO Z
register_optsZregister_cli_optsrý ÚenvironÚflagÚargvZlist_all_sectionsZsectionsZs3fuse.privsepr> r? Zsetupr rP Z getLoggerrS r8 ZloggerZsetLevelÚDEBUGÚINFOZWARNr] rª rR rY ZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetuserr ZgetgrgidÚgetgidZgr_namer r rc rf rm rn Úobjectro r r[ rt r r r¯ r rW rW rW rX Ú<module> s
"
4 yy
2