Why Gemfury?
Push, build, and install
RubyGems
npm packages
Python packages
Maven artifacts
PHP packages
Go Modules
Debian packages
RPM packages
NuGet packages
Repository URL to install this package:
|
Version:
4.2.32-4.2 ▾
|
python3-s3fuse-plugin
/
usr
/
lib
/
python3.6
/
site-packages
/
s3fuse
/
__pycache__
/
s3vaultfuse.cpython-36.opt-1.pyc
|
|---|
3
䓍a#J ã K @ s® d Z ddlZddlZddlZddlZddlZddlmZ ddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl m
Z
ddl mZ ddlmZ ddlmZ yddlmZmZ W n$ ek
rÐ ddlmZmZ Y nX ddlmZ dd lmZ ydd
lmZmZm Z W n dd
l mZmZm Z Y nX dd l T ddl Z ydd l m!Z! W n" ek
rf dd l"m!Z! Y nX dd
l#m$Z% ddl&m'Z' ddl(m)Z) ddl(m*Z* dZ+dZ,dZ-dZ.e!j/ddddde!j/dddd dgZ0e!j1d d d d e!j1d!d d"d e!j1d#d d$d e!j1d%dd&d'd(e!j1d)e+d*d+d(e!j1d,d d-d.d/e!j1d0d1d2d3e!j/d4dd5d6e!j1d7d8d9d6g Z2e!j/d:d;d<d6e!j/d=dd>d6e!j/d?dd@d6e!j/dAddBd6e!j3dCdDdEd6gZ4e!j3dFdGdHd6e!j3dIdJdKd6e!j1dLdMdNd6e!j1dOdPdQd6e!j1dRdSdTd6e!j1dUdVdWd6e!j1dXdYdZd6e!j1d[d\d]d6e!j5d^d_d`dadbdcddgded6e!j/dfddgd6e!j/dhddid6e!j1djdkdld6e!j1dmdkdnd6e!j3doddpd6gZ6e!j1dqdrdsd6e!j1dtdudve!j1dwdxdud6e!j1dydzd{d6e!j3d|e-d}d6e!j3d~e.dd6e!j3dddd6e!j3ddâdd6e!j3dddd6e!j1ddd dd(e!j1dddd6e!j1dddd6e!j1dddd6e!j1dddd6e!j1dddd6e!j1dddd6e!j1de' dd6e!j1dddd6e!j1dd d¡d6e!j1d¢d£d¤d6e!j1d¥d£d¦d6e!j1d§d¨d©d6e!j1dªd«d¬d6e!j1dd®d¯d6e!j1d°d±d²d6e!j/d³dd´d6gZ7e!j8Z8e8j9e7 e8j:e2 e8j:e4 e8j:e6 e8j:e0 y e;ej<dµ Z=e8e=g W n e8ej>dDd
Y nX d¶e8j? krtdd·l@mAZA n ddl(m)ZA e%jBe!j8e8jCjD e%jEe8jCjD ZFed¸d¹ZGyre8jHjD dkrÐeFjIjJe%jK nNe8jHjD dºkrðeFjIjJe%jL n.e8jHjD d»kreFjIjJe%jM neFjIjJe%jN W n& eOk
rF eFjIjJe%j%jN Y nX ddDg d¼dddddddddddddd½
d;dddej<jPd¾ej<jPd¿ej<jPddddd;dddddddddg ddd;ddd;dÁdÁdÁdÁddd&ZQe jR ZSdÃdĄ ZTdÅdƄ ZUdÁZVd¸ZWddlXZXeXjY ZZej[ej\ j]Z^dÇZ_i a`dÈZadÉdʄ ZbdËd̄ ZcdÍd΄ ZdG dÏdЄ dЃZeG dÑd҄ dÒefZgG dÓdԄ dÔegZhG dÕdք dÖefZiG d×d dØe ZjdãdÚdۄZkdÜd݄ ZldÞd߄ Zmendàkrªem dS )äad Trilio Fuse plugin implimentation
This module is based on the vaultfuse.py module and will eventually
become the new vaultfuse.py module once integration and refactoring
of the existing vaultswift.py is complete.
Currently this module is temporary for the 2.6 release and will be merged
into a new vaultfuse.py for the next release.
é N)Údatetime)ÚThread)ÚBoundedSemaphore)Úmkstemp)Úgetpwnam)ÚQueueÚEmpty)ÚLRUCache)ÚFUSEÚ FuseOSErrorÚ
Operations)Ú*)Úcfg)Úlog)Úget_ssl_cert_path)Úutils)Úvaults3z%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2éd é ÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarr zlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated. Please use logging_context_format_string and logging_default_format_string instead.)r r r zlog-date-formatZ DATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)r Údeprecated_namer zlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)r r z
use-syslogzUse syslog for logging.)r r zsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTz Log output to standard errorZ use_journalz%Enable Systemd native journal supportZ use_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_bursté z Burst limitZlog_rotate_intervalé z0Interval, number of hours, of log rate limiting.Zmax_logfile_counté< z Number of log files to retain.Zlog_rotate_interval_typeZHoursz Units of log rotation intervalZlog_rotation_typeZintervalztype of log retentionZ logging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZ logging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levelsz amqplib=WARNzsqlalchemy=WARNz boto=WARNz suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Úvault_storage_typeZs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)r Úvault_data_directory_oldz/var/triliovaultÚtmpfs_mount_pathÚtmpfszLLocation with respect to CONF.vault_data_directory_oldwhere tmpfs is mountedÚ queue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_counté z(The number of times we retry on failuresÚvault_segment_sizeé i z vault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileZvault_s3_auth_versionZDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚ z S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez S3 RegionÚvault_s3_bucketz S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionr zS3 signature version to useÚvault_s3_read_timeoutZ120z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolÚTruezEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Úvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).Ú vault_s3_max_pool_connectionsÚ500z>The maximum number of connections to keep in a connection poolÚbucket_object_lockz#S3 bucket object locking is enabledZFLAGZs3fuse_sys_admin)Úfsé )ÚvalueÚinfoÚwarnz1.0)
Z project_nameÚ region_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ tenant_idZ service_typeZ
project_idZ
auth_tokenZproject_domain_nameZ OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_tor ÚheaderÚ auth_versionÚ
os_optionsZssl_compressionZos_storage_urlZ os_usernameZ os_passwordZ os_cacertZos_certZos_keyZos_tenant_nameZ os_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclr? ZretriesZ write_aclÚmetar Zuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚ object_namec s t j fdd}|S )Nc
s t | |S Q R X d S )N)Ú
manifest_lock)ÚargsÚkwargs)Úwrapped© ú!/usr/lib/python3.6/s3vaultfuse.pyÚ_wrap s zsynchronized.<locals>._wrap)Ú functoolsÚwraps)rP rS rQ )rP rR Ú synchronized s rV c C sÄ dt d< tjt d< tjt d< tjt d< tjt d< tjt d< tjt d< tjt d < tj rbtj t d
d < tj
rvtj
t d
d < tj j d
krdt d< n2t
jjtj r¨tj t d< ntjdtj dt d< d S )Nz1.0rF rH rI ZbucketZ s3_signatureZs3_read_timeoutr9 r; rG rB rA ZfalseFZ s3_ssl_certzcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connectionr- )ÚoptionsÚCONFr, r. r0 r3 r4 r9 r; r1 r/ r2 ÚlowerÚosÚpathÚexistsÚLOGr@ rQ rQ rQ rR Ú
option_config s(
r^ z
%016x.%08xiè c s t j fdd}|S )Nc s~ yt j jt j W n$ tk
r6 t j jt j j Y nX | |}yt j jt j W n$ tk
rx t j jt j j Y nX |S )N)ÚloggingÚdisableÚERRORÚ
BaseExceptionZNOTSET)rN rO Úresult)ÚfuncrQ rR Úwrapper¹ s
z disable_logging.<locals>.wrapper)rT rU )rd re rQ )rd rR Údisable_logging¸ s rf c C sV t jj| \}}d}x8|dkrL|dkr6t jj||}n|}t jj|\}}qW ||fS )Nr- ú/)r- rg )rZ r[ ÚsplitÚjoin)r[ ÚheadÚtailÚprefixrQ rQ rR Úsplit_head_tailÈ s
rm c C s t jj| \}}|S )N)rZ r[ rh )r[ rj rk rQ rQ rR Úget_headÕ s rn c @ s& e Zd Zd ddZdd Zdd ZdS )
Ú tmpfsfileFc C s || _ || _d S )N)ÚremoveÚ persist_exit)Úselfrp rq rQ rQ rR Ú__init__Û s ztmpfsfile.__init__c C sL t jjtjtj}t|d\}| _t j| | j r>t j | j t
j | jS )N)Údir) rZ r[ ri rX r# r$ r Ú open_fileÚcloserp Ú
tmpfs_semaÚacquire)rr Útmpfs_mountpathÚfhrQ rQ rR Ú __enter__ä s
ztmpfsfile.__enter__c G s | j stj tj| j d S )N)rq rw ÚreleaserZ rp ru )rr rN rQ rQ rR Ú__exit__ï s ztmpfsfile.__exit__N)FF)Ú__name__Ú
__module__Ú __qualname__rs r{ r} rQ rQ rQ rR ro Ú s
ro c @ s e Zd Zdd Zdd Zdd Zdd Zd d
Zd d Zd
d Z dd Z
d ddZ d ddZ dd Z
dd Zdd Zd d ZdS ) ÚObjectRepositoryc K s
|| _ d S )N)Úroot)rr r rO rQ rQ rR rs ö s zObjectRepository.__init__c C s. |j dr|dd
}tjjt|}| j|S )Nrg r )Ú
startswithrZ r[ ri Ú_SEGMENT_PREFIXÚ
_full_path)rr Úpartialr[ rQ rQ rR Ú_full_segment_pathú s
z#ObjectRepository._full_segment_pathc C s* |j dr|dd
}tjj| j|}|S )Nrg r )r rZ r[ ri r )rr r r[ rQ rQ rR r
s
zObjectRepository._full_pathc C s d S )NrQ )rr rL ÚflagsrQ rQ rR Ú object_open s z ObjectRepository.object_openc C s d S )NrQ )rr rL ÚoffÚbufrz rQ rQ rR Ú
object_upload
s z ObjectRepository.object_uploadc C s d S )NrQ )rr rL Úoffsetrz rQ rQ rR Úobject_download
s z ObjectRepository.object_downloadc C s d S )NrQ )rr rL rQ rQ rR Ú
object_delete s z ObjectRepository.object_deletec C s d S )NrQ )rr rL rz rQ rQ rR Ú object_close s z ObjectRepository.object_closeNc C s d S )NrQ )rr rL Úlengthrz rQ rQ rR Úobject_truncate s z ObjectRepository.object_truncatec C s d S )NrQ )rr rL rz rQ rQ rR Úobject_getattr s z ObjectRepository.object_getattrc C s d S )NrQ )rr r[ rz rQ rQ rR Úobject_readdir s z ObjectRepository.object_readdirc C s d S )NrQ )rr r[ ÚmoderQ rQ rR Ú
object_access s z ObjectRepository.object_accessc C s d S )NrQ )rr r[ rQ rQ rR Ú
object_unlink" s z ObjectRepository.object_unlinkc C s d S )NrQ )rr r[ rQ rQ rR Ú
object_statfs% s z ObjectRepository.object_statfs)N)N)r~ r r rs r r
r r r r r r r r r r r rQ rQ rQ rR r õ s
r c s e Zd Z fddZG dd deZG dd dZdd Zd d
Zd d Z d
d Z
dd Z i fddZ dd Z
dd Zedd Zdd Zdd Zed d Zd d Zd!d" Zed#d$ Zed%d& ZdYd(d)Zd*d+ Zd,d- Zd.d/ Z d0d1 Z dZd2d3Z d4d5 Z d6d7 Z d8d9 Z!d:d; Z"d<d= Z#d>d? Z$d@dA Z%d[dCdDZ&dEdF Z'd\dGdHZ(dIdJ Z)dKdL Z*dMdN Z+dOdP Z,dQdR Z-dSdT Z.d]dUdVZ/dWdX Z0 Z1S )^ÚBackendRepositoryc sb t t| j|f| ttj| _ttj| _i | _ t
j t | _
i | _i | _i | _| jdt | _d S )Nr )Úsuperr rs r Ú FUSE_USERÚpw_uidrC Úpw_gidÚgroup_idÚmanifestr Ú S3BackendrW Ú_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ _BackendRepository__worker_poolÚ _BackendRepository__pending_iosÚBackendWorkerPoolÚ,_BackendRepository__object_open_backend_pool)rr r rO )Ú __class__rQ rR rs * s zBackendRepository.__init__c @ s0 e Zd ZdZdd Zdd Zdd Zdd Zd
S ) z BackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
c C s8 t j| tj|| _|| _tj | _d| _ | j
d S )NT) r rs r r Ú_BackendWorker__backendÚ_BackendWorker__job_queueÚ threadingZEventÚ _stop_eventZdaemonÚstart)rr Ú job_queuerW rQ rQ rR rs K s
z(BackendRepository.BackendWorker.__init__c C s | j j d S )N)r« Úset)rr rQ rQ rR ÚstopU s z$BackendRepository.BackendWorker.stopc C s
| j j S )N)r« Zis_set)rr rQ rQ rR ÚstoppedX s z'BackendRepository.BackendWorker.stoppedc C s¤ t jdtj j x| j sy<| jjdd\}}}z|| jf|| W d| jj X W q t
k
rp wY q t k
r } zt j | W Y dd}~X qX qW dS )zO Start up the worker and block until there is an item in the queue
zStarting worker thread[%x].Tr N)
r] r? rª Úcurrent_threadÚidentr° r© Úgetr¨ Z task_doner Ú ExceptionÚ exception)rr rd rN ÚkargsÚerQ rQ rR Úrun[ s
z#BackendRepository.BackendWorker.runN)r~ r r Ú__doc__rs r¯ r° r¸ rQ rQ rQ rR Ú
BackendWorkerG s
rº c @ s8 e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd S )
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
c C s> t tj| _g | _x&t|D ]}| jjtj| j| q W d S )N) r rX r& r ÚworkersÚrangeÚappendr rº )rr Z num_threadsrW Ú_rQ rQ rR rs t s
z,BackendRepository.BackendWorkerPool.__init__c C s4 x| j D ] }|j qW x| j D ] }|j q W d S )N)r» r¯ ri )rr ÚtrQ rQ rR Ú__del__| s z+BackendRepository.BackendWorkerPool.__del__c O s | j j|||f dS )z+ Add a job to the worker queue
N)r Zput)rr rd rN r¶ rQ rQ rR Úadd_job s z+BackendRepository.BackendWorkerPool.add_jobc C s x|D ]}| j || qW dS )z4 Add a list of jobs to the worker queue
N)rÁ )rr rd Z args_listrN rQ rQ rR Úmap s
z'BackendRepository.BackendWorkerPool.mapc C s | j j dS )z> Wait for completion of all the jobs in the queue
N)r ri )rr rQ rQ rR Úwait_completion s z3BackendRepository.BackendWorkerPool.wait_completionN) r~ r r r¹ rs rÀ rÁ r rà rQ rQ rQ rR r¥ p s r¥ c C sV t jj|\}}d}x8|dkrL|dkr6t jj||}n|}t jj|\}}qW ||fS )Nr- rg )r- rg )rZ r[ rh ri )rr r[ rj rk rl rQ rQ rR rm s
z!BackendRepository.split_head_tailc C s t jj|\}}|S )N)rZ r[ rh )rr r[ rj rk rQ rQ rR Ú _get_head s zBackendRepository._get_headc C s. |j dr|dd
}tjjt|}| j|S )Nrg r )r rZ r[ ri r Ú
_get_cache)rr r r[ rQ rQ rR Ú_get_segment_cache£ s
z$BackendRepository._get_segment_cachec C s* |j dr|dd
}tjj| j|}|S )Nrg r )r rZ r[ ri r )rr r r[ rQ rQ rR rÅ © s
z BackendRepository._get_cachec C s> | j |\}}i }i }tj }||d< t|}| jj|}|S )NrL )rm rW ÚcopyÚbunchifyr¡ Zget_object_manifest)rr rL Ú containerrl Ú put_headersÚmrÚ_optsr rQ rQ rR Ú_read_object_manifest¯ s z'BackendRepository._read_object_manifestc C sl | j |\}}i }i }d|d< tj }||d< x |j D ]\} }
|
|d| < q8W t|}| jj||| d S )NÚtruezx-static-large-objectrL zx-object-meta-)rm rW rÇ ÚitemsrÈ r¡ Zupload_object_manifest) rr rL Úobject_manifestÚmetadatarÉ rl rÊ rË rÌ rI r> rQ rQ rR Ú_write_object_manifestà s
z(BackendRepository._write_object_manifestc C sB t jd| tj }t|}t|jdd g}| jj|| d S )Nz mkdir, %srg z -segments) r] r rW rÇ rÈ r Úlstripr¡ Ú mkdir_object)rr rL rÌ rN rQ rQ rR Ú_create_segments_folderÕ s
z)BackendRepository._create_segments_folderc C sÌ | j |\}}tj }|dkr$g }n|g}d |d< d|d< d|d< d|d< d |d< t|}i }|dkrz||d< |j| nd }| jj||}i }x6|d d j D ]"\} }
d
| kr¢|
|| jd
d < q¢W |S ) Nr- Ú delimiterFÚhumanÚtotalsÚlongrl ÚheadersZMetadatazx-object-meta-r ) rm rW rÇ rÈ r½ r¡ Ú stat_objectrÏ rh ) rr rL rÉ rl rÌ rN r ÚstrÑ rI r> rQ rQ rR Ú_get_object_metadataÞ s, z&BackendRepository._get_object_metadatac O C sÔ | j |\}}| j|}| jj|tj | j|< |tjkpX|tddtddtddfk}| j| || j krè|tjksæ|tddtddtddfksæ|tddtddfksæ|tddtddtd dfksæ|td
dkrLy| j
|}W nF t k
r: } z(t j
d | tjd | j
|}W Y d d }~X nX d
i i| j |< xZ|D ]R} | d jdd jdd }
t|
d} | jdd| d< d| d< | | j | | < qPW | j|} | j | j| y"| j| j | d }
tj|
W n tk
rø Y nX tjjtjj|s"tjtjj| t|d}|jtj| W d Q R X ntjjtjj|sttjtjj| |tddtddtddfks¢|tj krúy| j | W n tk
rÆ Y nX yt|d}W d Q R X W n tk
rø Y nX y | j |d }
tj|
W n tk
r, Y nX tj||}zJ| j | | j | j!|< d
i i| j |< d di| j | d
|< | j"|| W d | j!j#|d | j | d
j#|d tj$| X yt|d}W d Q R X W n tk
ræ Y nX W d Q R X y dd l%m&} ||j' W n Y nX tj||}y:d |i| j | d
|< | j(t)j*t+| j!|< t, | j-|< |S t k
rÎ } zNt j.| | j!j#|d | j | d
j#|d | j-j#|d tj$| W Y d d }~X nX d S ) NZ8000é Z8800Zc000Z8401Z8402Z8002Z8802Zc002Z28000z+Manifest for %s not found. Trying in 5 secsr Ú open_handlesÚnamez
-segments/r Ú.r Ú versionIdr- FÚmodifiedz segments-dirÚwZ8001Z8801Z0001z -segmentsÚreadonly)ÚPath)/rm r
r¢ r³ rª ÚRLockrZ ÚO_RDONLYÚintr rÍ r´ r] r? ÚtimeÚsleeprh rÝ ÚupdateÚmakedirsrb r[ r\ ÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_RDWRr r rÕ r¦ r£ Ú
_object_closeÚpoprv Zpathlibræ Ztouchr¥ rX r' rW r® r¤ rµ )rr rL r rÉ rl Ú full_pathrå r ÚexÚsegZoffstrr rÑ Z segment_dirÚfrz ræ rQ rQ rR r s¾
z BackendRepository.object_openc C sR y t j }t|}|j|| W n, tk
rL } ztj| W Y dd}~X nX dS )zñ Utility method to be dispatched to a worker thread in order to clean up old segments.
Args:
backend (class instance): Instance of the backend plugin.
segment_list (list): List of segments to remove.
N)rW rÇ rÈ Údelete_object_listr´ r] rµ )rr ÚbackendÚ segment_listrÌ r÷ rQ rQ rR Z__purge_old_segments_task¦ s z+BackendRepository.__purge_old_segments_taskc C s° | j | j | j| yT| j| jddt | d }| j|\}}g }i }d}| j| d | d spd} d}
d} x8| | j| krP y | j| j| | d |} W n0 tj d | j| j| | d |} Y nX | j| | d r6t
| }
t |
j t
j} |j| j| | d |
j|
j| |
jd
nd| j| | d } |j| j| | d | j| | jd d
| j| | d | | j| | d d
| t
j7 } |d7 }|
| 7 }
qW | j|||t|t|
dd d} xdrn|rn| j||| }t|dkrP t|}| j| | d jd}tt|t|g }t|dkr`| j | j| j | | t
j7 } qÞW dS t k
r } zt j | W Y dd}~X nX W dQ R X dS )zé Handle object_close by updating the manifest.
Waits for all of the background jobs to complete prior to updating
manifest using the main thread. Also queues up tasks to clean up
any old segments.
z segments-dirrg z -segmentsr rß rå rà r rã )r[ râ ÚetagÚ
size_bytesÚ content_typerþ râ r- Úhashrÿ r )z segments-dirz
segment-countz
total-size)rÑ TN) r£ rà r¢ r r³ r rm r rê rë rÈ ÚminÚst_sizerX r) r½ Ú
version_idrý rÿ rÒ Ústrrü ÚlenÚsortedÚstripÚlistr® rÁ Ú+_BackendRepository__purge_old_segments_taskr´ r] rµ )rr rL rz Ú segments_dirrÉ rl rÐ Z
segments_listZsegmentsr Z
total_sizeÚ segment_sizerÜ ÚstatZobjectsÚpZ
purge_listr÷ rQ rQ rR rô ´ s
z BackendRepository._object_closec C sÚ | j || | jj| | jj| | j| d j| ytj| W n tk
rZ Y nX | j| R t | j| d dkr´ytj
| j | W n tk
r¦ Y nX | jj| W d Q R X || jkrÖ| jj|d d S )Nrß r ) rô r£ rõ r¤ r rZ rv rb r¢ r rp r
)rr rL rz rQ rQ rR r , s"
z BackendRepository.object_closec # C s | j | t y*|| j| krJ| j| | d dkrJ| j| | d }n8| j||}| j| jddt | d }tjj||}tj }d| j| k|d< | j
|\} }
t dd 2} t | d
} | j
| W d Q R X t||d < W d Q R X |
jd|d < t|}| | g}
| j| j| | j| j| j|
||||| W n@ tk
rz } z"tj| | j| j| W Y d d }~X nX W d Q R X d S )
Nrã Trà z segments-dirrg z -segmentsÚ0Ú
path_valid)rq Úwbr rL )r¢ r Ú,_BackendRepository__next_segname_from_offsetr³ r rZ r[ ri rW rÇ rm ro rï rð r ÚrstriprÈ r¤ Úaddr£ rÁ Ú&_BackendRepository__object_upload_taskr´ r] rµ rp )rr rL r r rz Ú seg_fullnameZsegnamer
rÌ rÉ ÚobjÚtempfsrù Úargs1r÷ rQ rQ rR r B s8
z BackendRepository.object_uploadc
* C s> t jd||tj jf | j| W dQ R X zpyd|_|j||}W nT tk
r } z8t j | | j| | j
| j | W dQ R X W Y dd} ~ X nX W dt j
tj |d X | j| p || j| krâi | j| |< || j| | d< d| j| | d< |jdd| j| | d < | j
| j | W dQ R X dS )
zP Method run by a worker in the thread pool to upload an object segment.
z6Object [%s] segment [%s] upload running in thread[%x].NTr rà rã Ú VersionIdr- râ )r] r? rª r± r² r¢ r Z
upload_objectr´ rµ r¤ rp rw r| rZ r r³ )
rr rû r rÌ rL r r rz Zrespr÷ rQ rQ rR Z__object_upload_taskk s,
z&BackendRepository.__object_upload_taskc
C sb xvt jd | j| X || j| kr(w|| j| krVtd| tt|tdf | j| | d }P W d Q R X qW | j|j d\}}t
ddÂ}t j }d |d< d |d < |j d|d
< | j| | j
d d |d
< t|}||g} y:| jj| | t|j dd}
|
j } W d Q R X t| S tk
rR } ztj| W Y d d } ~ X nX W d Q R X d S )Ng¹?zobject %s not foundr rà rg T)rp rl Z
out_directoryZout_filerâ r- r Úrb)rê rë r¢ r¤ r r´ ÚSEGMENT_FORMATré rm r ro rW rÇ r³ rÈ r¡ Zdownload_objectrï ÚreadÚ bytearrayr] rµ )
rr rL r rz r rÉ r r rÌ r rù r r÷ rQ rQ rR r s8
z!BackendRepository.object_downloadc C s | j |\}}tj }t|}|g}|dkr>|dkr>|j| y| jj|| W n, tk
r| } ztj | W Y d d }~X nX d S )Nr- rg )
rm rW rÇ rÈ r½ r¡ Z
delete_objectr´ r] rµ )rr rL rÉ r rÌ r r÷ rQ rQ rR r ² s
z BackendRepository.object_deleteNc C s& |rd S | j |tj}| j|| d S )N)r rZ ÚO_WRONLYr )rr rL r rz rQ rQ rR r  s z!BackendRepository.object_truncatec C sp t j }d |d< d|d< d|d< d|d< tjj|dt| |d< g }|dkrTg }n|g}t|}| jj||S ) NrÖ Fr× rØ rÙ z%016xrl r- ) rW rÇ rZ r[ ri ré rÈ r¡ Z
list_segments)rr rÉ r
r rÌ rN rQ rQ rR rü È s z BackendRepository.segment_listc C sÀ | j |\}}| j| jdd }|rT|jdt r@| j |\}}| j |\}}|}n|d }| j|||}t|dkrtt|tdf S tt|tt |d j
|d j
dd dd f S ) Nz segments-dirrg z -segmentsr r rá rÞ éÿÿÿÿ) rm r r³ r r rü r r ré r rh ) rr r[ r rÉ rl r
Úcr
ÚfilesrQ rQ rR Z__next_segname_from_offsetÚ s $z,BackendRepository.__next_segname_from_offsetc
C sò | j | | j|\}}| jj|d rV|| j| krV| j| | d }|jdd S | j| jdd }|r| j|\}}|}n|d }| j|||} W d Q R X t| dkrÀtt|tdf S tt|tt | d j|d jdd df S )
Nrà z
-segments/r z segments-dirz -segmentsr rá rÞ r )
r¢ rm r r³ rh rü r r ré r )
rr r[ r rÉ rl rø r
r r
r! rQ rQ rR Úcurr_segname_from_offsetï s z*BackendRepository.curr_segname_from_offsetc s t jj|r~y@t j| t fdddD }d |d < t|d d |d
< |S tk
rx } ztj| W Y dd}~X nX dS dS )aÆ Utility to check the tmpfs cache and return stat() from that.
This method looks to see if the object (directory) exists in the
local cache and will perform a stat() locally instead of calling
all the way to the backend.
Args:
object_cache_path (str): Cache path to the object we need stat infor on.
Returns:
Dictionary of stat() information or None if object does not exist.
c 3 s | ]}|t |fV qd S )N)Úgetattr)Ú.0rI )rÜ rQ rR ú <genexpr> s z0BackendRepository._stat_cache.<locals>.<genexpr>Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkr Úst_uidi Ú
st_blksizeÚ st_blocksN)r& r' r( r) r* r+ r r, ) rZ r[ ÚisdirÚlstatÚdictré r´ r] rµ )rr Zobject_cache_pathÚ stat_infor· rQ )rÜ rR Ú _stat_cache s(
z BackendRepository._stat_cachec $ sä | j |}| j|}|d k r |S | j|\}}tj }|dkrDg }n|g}d |d< d|d< d|d< d|d< d |d< t|}i }|dkr||d< |j| nd }y`| jj|| | j |d< | j
|d < d
j d d|d < d
j d
d|d< d
j dd|d< t d |d< t d |d< t d |d< d|d< d|d< |d k r\d|kr\d|d< t d |d < |d d kr|dksÂ|d d kr|d ksÂ|d d kr´|dks d d krþd |d< d!|d < d"|d< | j
|} tjj| sþtj| d# W n tk
r }
z¤ytj| W nn tk
r y@d |d< | jj| |jd$ krhtj|d# n
tj| W n tk
r Y nX Y nX tj| t fd%d&d*D }W Y d d }
~
X nX d'|d(< t |d d' |d)< |S )+Nr- rÖ Fr× rØ rÙ rl r( r, rÚ ZETagrý r r Z ContentTyperÿ Z timestampr& r' r* r r+ ií r) Zauthorized_keyi Úsizer r Z directoryTé i iýA ié rg c 3 s | ]}|t |fV qd S )N)r# )r$ rI )rÜ rQ rR r% x s z3BackendRepository.object_getattr.<locals>.<genexpr>i r- r. )r& r' r( r) r* r+ r r, )r
r3 rm rW rÇ rÈ r½ r¡ rÛ r rC r³ ré rÅ rZ r[ r\ Úmkdirr´ r0 rb Ú list_objectsr r] r? r1 ) rr rL rz rö r rÉ rl rÌ rN Zcontainer_pathr÷ rQ )rÜ rR r 1 s
z BackendRepository.object_getattrc C sþ yt j|d}W n. tk
r> } ztj| W Y d d }~X nX d}x||| j| krÀy | jj| j| | d | W n2 tj d | jj| j| | d | Y nX || j| | d 7 }qFW y| jj
|| W n$ tj d | jj
|| Y nX d S )Nz%Y-%m-%dT%H:%M:%Sr rà r rþ ) r Zstrptimer´ r] rµ r r¡ Z put_object_segment_retentionrê rë Zput_manifest_retention)rr rL Ú retainuntilÚdtr÷ r rQ rQ rR Ú_set_object_retention s(
z'BackendRepository._set_object_retentionc C s | j |tj}zîyº| j| ¦ tj| j| }d}x8|| j| krj| j| | d }|j|d ||7 }q4W |jdd |dkr| j||j d n |j d||< | j
j || || j| |< W d Q R X W n. t k
rø } zt
j| W Y d d }~X nX W d | j|| X d S )Nr rþ rß r8 Úutf8zutf-8)r rZ rè r¢ rÇ Údeepcopyr rõ r: Údecoder¡ Úupdate_object_attributesr´ r] rµ r ) rr rL rà r> rz Úattrsr r4 r÷ rQ rQ rR Úobject_setxattrª s(
z!BackendRepository.object_setxattrc C s² | j |tj}zy\| j| H tj| j| }|j| |jd | jj || | j| j| W d Q R X W n. t
k
r } zt j | W Y d d }~X nX W d | j
|| X d S )Nrß )r rZ rè r¢ rÇ r< r rõ r¡ r> r´ r] rµ r )rr rL rà rz r? r÷ rQ rQ rR Úobject_removexattr s
z$BackendRepository.object_removexattrc C s | j |tj}zpy<| j| ( tj| j| }|jd |j }|S Q R X W n. t k
rz } zt
j | W Y d d }~X nX W d | j || X d S )Nrß )
r rZ rè r¢ rÇ r< r rõ Úkeysr´ r] rµ r )rr rL rz r? rB r÷ rQ rQ rR Úobject_listxattrÒ s
z"BackendRepository.object_listxattrc C s | j |tj}z^y*| j| t| j| | dS Q R X W n. tk
rh } ztj| W Y d d }~X nX W d | j || X d S )Nzutf-8)
r rZ rè r¢ Úbytesr r´ r] rµ r )rr rL rà rz r÷ rQ rQ rR Úobject_getxattrá s
z!BackendRepository.object_getxattrc c sd g }|j dd }g }|| jj|7 }x |D ]}|j|jdd q,W xt|D ]
}|V qRW d S )Nrg r r )r r¡ r7 r½ rh r )rr rL rz ZlistingZdir_pathÚdirentsZlstÚrrQ rQ rR r ì s
z BackendRepository.object_readdirc C s d S )NrQ )rr rL r rQ rQ rR r ÷ s z BackendRepository.object_accessFc C s |t d< t j }t|}|sØy| j|}| j|}g }x|D ]}|j|d q<W | jj|| |jd}|d k r¨|g} | jj | | yt
j | j | W n Y nX W n, t
k
rÖ }
ztj|
W Y d d }
~
X nX y| jj| W n. t
k
r }
ztj|
W Y d d }
~
X nX d S )NrK rà z segments-dir)rW rÇ rÈ rÍ rÝ r½ r¡ rú r³ Ú rmdir_objectrZ ÚrmdirrÅ r´ r] rµ Zdelete_object_manifest) rr rL rK rÌ Z obj_manifestZ obj_metadatarü Úmanr
rN r÷ rQ rQ rR r ú s6
z BackendRepository.object_unlinkc C sÐ t j }t|}g }y| jj||}W n6 tk
r\ } ztj| tt j
W Y d d }~X nX d|d krt |d }t |d t |d }nd }t |d }i }||d< ||d< ||d< d |d
< d |d < |S )
Nzx-account-meta-quota-bytesrÚ zx-account-bytes-usedr r4 Úf_blocksÚf_bfreeÚf_bavailr Úf_favailÚf_frsizer ) rW rÇ rÈ r¡ rÛ r´ r] rµ r ÚerrnoÚENOENTré ) rr rL rÌ r Zstvr÷ rK rM r9 rQ rQ rR r s*
z BackendRepository.object_statfsc
C sÚ t jd| | j|\}}tj }t|}||g}y| jj|| W n* tk
rp } zt j | dS d }~X nX | j
|} |dkr| j
t j j
||} yt j| | W n, tk
rÔ } zt j | W Y d d }~X nX dS )Nz mkdir, %sr F)r] r rm rW rÇ rÈ r¡ rÔ r´ rµ rÅ rZ r[ ri rí )
rr r[ r ZistrÉ r rÌ rN r÷ Ú
cache_pathrQ rQ rR r6 8 s$
zBackendRepository.mkdirc : C sØ | j |\}}tj }d |d< t|}|jdd }g }y|| jj|dd7 }W n, tk
r| } ztj | W Y d d }~X nX t
|dkrt t j
y| jj|jdg| W n, tk
rÚ } ztj | W Y d d }~X nX tjjt|jd}y|| jj|dd7 }W n. tk
r6 } ztj | W Y d d }~X nX t
|dkry| jj|jdg| W n. tk
r } ztj | W Y d d }~X nX | j|} tjj| r²tj| | j|}
tjj|
rÔtj|
S d S )Nrl rg r( )Z max_itemsr )rm rW rÇ rÈ r r¡ r7 r´ r] rµ r r rP Z ENOTEMPTYrH rZ r[ ri r rÓ rÆ r/ rI rÅ ) rr rL rÉ r rÌ r[ Z dir_itemsr÷ Zseg_pathZsegment_cache_pathrR rQ rQ rR rI X sD
zBackendRepository.rmdirc C sV t jd| y.| j|\}}| jtjj||}tj||S tk
rP Y nX d S )Nz chmod, %s) r] r rm rÅ rZ r[ ri Úchmodrb )rr r[ r rÉ rl rR rQ rQ rR rS s zBackendRepository.chmodc C sX t jd| y0| j|\}}| jtjj||}tj|||S tk
rR Y nX d S )Nz chown, %s) r] r rm rÅ rZ r[ ri Úchownrb )rr r[ ÚuidÚgidrÉ rl rR rQ rQ rR rT s zBackendRepository.chownc C s t dd S )NzNot Applicable)r´ )rr rà ÚtargetrQ rQ rR Úsymlink s zBackendRepository.symlinkc
[ C s" | j j|d r2tjd | j j|d r2td| tjd||f |d }y| j|dd W n, tk
r } ztj| W Y d d }~X nX yJ| j |}| j |}|jd|d |jd|d krÔ| j|dd d S W n" tk
rø } zW Y d d }~X nX d
}y¸y| j |}W n$ tk
r2 } zW Y d d }~X nX | j
|}|jd|d } g }
x<|D ]4} |
j | d | d | d
| jdd| d d qXW | j ||
| |d |d dd d}W n0 t
k
ræ } ztj| W Y d d }~X nX zêyÌ| j
|} | j |}|jd|d } g }x<| D ]4} |j | d | d | d
| jdd| d d qW | j ||| |d |d dd y| j|dd W n. tk
r² } ztj| W Y d d }~X nX W n t
k
rÎ Y nX W d |r y| j|d
d W n. tk
r } ztj| W Y d d }~X nX X d S )Né z%s in use. Try againzrename, %s -> %sú~T)rK z segments-dirz -segmentsr Frà r rþ râ r- rÿ )r[ rý rþ râ rÿ z
segment-countz
total-size)z segments-dirz
segment-countz
total-size)rÑ )r r³ rê rë r´ r] r r rµ rÝ rÍ r½ rÒ rb )
rr ÚoldÚnewZ newbak_namer÷ Z new_metadataZ old_metadataZnewfile_existsZ new_manifestr
Znewbak_manifestrJ Z old_manifestrQ rQ rR Úrename s
zBackendRepository.renamec C sZ t jd| t|\}}| jtjj||}t|\}}| jtjj||}tj||S )Nzlink, %s)r] r rm rÅ rZ r[ ri Úlink)rr rW rà rÉ rl Zcache_path_targetZcache_path_namerQ rQ rR r^ s zBackendRepository.linkc C sN t jd| t|\}}| j|}ytj|| W n tk
rH dS X dS )Nz utimens, %sr )r] r rm rÅ rZ Úutimerb )rr r[ ÚtimesrÉ rl rR rQ rQ rR Úutimens s
zBackendRepository.utimensc C sX y>t jjtjtj}t jj|r<t jj|r<tj |d dd W n t
k
rR Y nX dS )NrY )Ztimeoutr ) rZ r[ ri rX r# r$ r/ Úismountr< Úumountrb )rr r[ ry rQ rQ rR Údestroy" s
zBackendRepository.destroy)N)N)F)F)N)2r~ r r rs r rº r¥ rm rÄ rÆ rÅ rÍ rÒ rÕ rÝ rV r r rô r r r rf r r r rü r r" r3 r r: r@ rA rC rE r r r r r6 rI rS rT rX r] r^ ra rd Ú
__classcell__rQ rQ )r§ rR r ) sX )# ; x )$ #
)
[
. s
r c @ sp e Zd Zdd Zdd ZdddZdd Zd d d Zd
d Zdd Z dd Z
dd Z dd Z dd Z
dd Zd
S ) Ú FuseCachec C sb || _ || _t| _ttj| _ttj| _t j
j | j sy4t j
| j t j| j t| jd t| j g W qÎ tk
r Y qÎX nHt j| j }|j| jksª|j| jkrÎt jtjt| jd t| j g yvt j
jtjtj}t j
j |søtj| t j
j|sBdttj ttj }dd|d }t j dd|d|g W n tk
r\ Y nX d S )Nú:r= zsize=%dM,mode=0777r( i r% z-o) r Ú
repositoryÚlrucacher r r rC r r rZ r[ r/ r< r6 rT r rb r r, r( rX r# ri r$ r Z ensure_treerb ré r) r+ Zmount)rr r rh r2 ry Z
tmpfs_sizeZtmpfs_buffer_cfgrQ rQ rR rs D s6 (
$
zFuseCache.__init__c C sL | j j||}| jj|d r(| jj| ttjdtj |t
d| j|< |S )N)Úmaxsize)ri ÚlrulockrL Ú writes_before_update_manifest) rh r ri r³ rõ r rX r+ rª ÚLockÚNUMBER_UPLOADS_BEFORE_FLUSH)rr rL r rz rQ rQ rR r i s
zFuseCache.object_openTc C s t jd|tj jf | j| }|d }|d P y4x.|j \}}|d r8| jj|||d | q8W W n t k
r| Y nX W d Q R X |r| jj
|| d S )Nz Cache object_flush [%s] [%x]ri rk rã Údata) r] r rª r± r² ri Úpopitemrh r ÚKeyErrorrô )rr rL rz Úupdate_manifestÚitemÚcacher rQ rQ rR Ú object_flushv s
zFuseCache.object_flushc C sF t jd|tj jf | j||dd | jj|| | jj | d S )Nz Cache object_close [%s] [%x]F)rr )
r] r rª r± r² ru rh r ri rõ )rr rL rz rQ rQ rR r s zFuseCache.object_closeNc C s | j j||| d S )N)rh r )rr rL r rz rQ rQ rR r s zFuseCache.object_truncatec c sV xP|dkrP|t j t j }|| }t|t j| }|||fV ||7 }||8 }qW d S )Nr )rX r) r )rr r r Z
seg_offsetÚbaseÚseg_lenrQ rQ rR Ú_walk_segments s
zFuseCache._walk_segmentsc ! C sp t }| j| d L xB| j||D ]0\}}}y| j| d | d } W nö tk
rD y²| j| d }
t|
tjkrè|
j \} } | d rè| jj || | d | | j| d d8 < | j| d sè| jj
|| t | j| d< | jj |||} d| d| j| d |< W n, t
k
r> }
ztj|
d S d }
~
X nX Y nX || |||
7 }q(W W d Q R X t|S )
Nrk ri ro rã rl r F)rã ro r )r ri rx rb r rX r+ rp rh r rô rn r r´ r] rµ rD )rr rL r r rz Z
output_bufÚ segoffsetrv rw Úsegdatart r rs r÷ rQ rQ rR Ú object_read¥ s>
"zFuseCache.object_readc C sÀ t jd|tj jf t|}d}| j| d ~ xt| j||D ]b\}}} | j| d }
||
krFt|
tj krâ|
j
\} } | d râ| j j || | d | | j| d d8 < | j| d sâ| j j
|| t| j| d< y4| j j|||}
|
d krtd d
|
d |
|< W n, tk
rB td}
d |
d |
|< Y nX n |
| d }
t|
|k rz|
jd
|| t|
||||
|
|||
< d |
| d< || 7 }qFW W d Q R X t|S )Nz Cache object_write [%s] [%x]r rk ri rã ro rl r zObject not foundF)rã ro Tó )r] r rª r± r² r ri rx rX r+ rp rh r rô rn r r´ rb r Úextend)rr rL r r rz r Zbufptrry rv rw rt r rs rz rQ rQ rR Ú object_writeÞ sL
zFuseCache.object_writec C s t j| jj||S )N)rZ r6 rh r
)rr r[ r rQ rQ rR r6 2 s zFuseCache.mkdirc C s | j j|}tj|S )N)rh r
rZ rI )rr r[ rö rQ rQ rR rI 5 s zFuseCache.rmdirc C s | j j|}tj||S )N)rh r
rZ rS )rr r[ r rö rQ rQ rR rS 9 s zFuseCache.chmodc C s | j j|}tj|||S )N)rh r
rZ rT )rr r[ rU rV rö rQ rQ rR rT = s zFuseCache.chown)T)N)r~ r r rs r ru r r rx r{ r~ r6 rI rS rT rQ rQ rQ rR rf C s %
9Trf c @ sú e Zd Zd:ddZdd Zdd Zdd Zed;d
d Zd d
Z dd Z
dd Z dd Z dd Z
dd Zdd Zdd Zd d Zd d Zd d! Zd"d# Zd$d% Zd&d' Zd<d(d)Zd*d+ Zd=d,d-Zd.d/ Zd0d1 Zd>d2d3Z d4d5 Z d6d7 Z d8d9 Z dS )?Ú TrilioVaultNc C s& || _ |pt|| _t|| j| _d S )N)r r rh rf rt )rr r rh rQ rQ rR rs B s zTrilioVault.__init__c C s | j j|| d S )N)rh r )rr r[ r rQ rQ rR ÚaccessJ s zTrilioVault.accessc C s | j j||S )N)rh rS )rr r[ r rQ rQ rR rS M s zTrilioVault.chmodc C s | j j|||S )N)rh rT )rr r[ rU rV rQ rQ rR rT P s zTrilioVault.chownc C s | j j||S )N)rh r )rr r[ rz rQ rQ rR r# S s zTrilioVault.getattrc C s | j j|||S )N)rh r@ )rr r[ rà r> r4 rQ rQ rR ÚsetxattrW s zTrilioVault.setxattrc C s, |j ds|j dr tddS | jj||S )NZsecurityÚsystemr- zutf-8)r rD rh rE )rr r[ rà rQ rQ rR ÚgetxattrZ s
zTrilioVault.getxattrc C s | j j|S )N)rh rC )rr r[ rQ rQ rR Ú listxattr_ s zTrilioVault.listxattrc C s | j j||S )N)rh rA )rr r[ rà rQ rQ rR Ú removexattrb s zTrilioVault.removexattrc c s4 ddg}|j | jj|| x|D ]
}|V q"W d S )Nrá z..)r} rh r )rr r[ rz rF rG rQ rQ rR Úreaddire s
zTrilioVault.readdirc C s2 t j| j|}|jdr*t jj|| jS |S d S )Nrg )rZ Úreadlinkr
r r[ Úrelpathr )rr r[ ÚpathnamerQ rQ rR r k s
zTrilioVault.readlinkc C s t j| jj|||S )N)rZ Úmknodrh r
)rr r[ r ZdevrQ rQ rR r } s zTrilioVault.mknodc C s | j j|S )N)rh rI )rr r[ rQ rQ rR rI s zTrilioVault.rmdirc C s | j j||S )N)rh r6 )rr r[ r rQ rQ rR r6 s zTrilioVault.mkdirc C s | j j|S )N)rh r )rr r[ rQ rQ rR Ústatfs s zTrilioVault.statfsc C s | j j|S )N)rh r )rr r[ rQ rQ rR Úunlink s zTrilioVault.unlinkc C s | j j||S )N)rh rX )rr rà rW rQ rQ rR rX s zTrilioVault.symlinkc C s | j j||S )N)rh r] )rr r[ r\ rQ rQ rR r] s zTrilioVault.renamec C s | j j||S )N)rh r^ )rr rW rà rQ rQ rR r^ s zTrilioVault.linkc C s | j j||S )N)rh ra )rr r[ r` rQ rQ rR ra s zTrilioVault.utimensc C s | j j||S )N)rt r )rr r[ r rQ rQ rR rï s zTrilioVault.openc C s | j |tjS )N)rï rZ ÚO_CREAT)rr r[ r ZfirQ rQ rR Úcreate s zTrilioVault.createc C s | j j||||}|S )N)rt r{ )rr r[ r r rz r rQ rQ rR r ¡ s zTrilioVault.readc C s | j j||||S )N)rt r~ )rr r[ r r rz rQ rQ rR rð ¥ s zTrilioVault.writec C s | j j|||d d S )N)rz )rt r )rr r[ r rz rQ rQ rR Útruncate¨ s zTrilioVault.truncatec C s | j j|| d S )N)rt ru )rr r[ rz rQ rQ rR Úflush« s zTrilioVault.flushc C s | j j|| d S )N)rt r )rr r[ rz rQ rQ rR r| ® s zTrilioVault.releasec C s t jd| | jj|S )Nz destroy, %s)r] r rh rd )rr r[ rQ rQ rR rd µ s zTrilioVault.destroy)N)N)N)N)N) r~ r r rs r rS rT rf r# r r r r
r r r rI r6 r r rX r] r^ ra rï r r rð r r r| rd rQ rQ rQ rR r A s:
r ú/etc/fuse.confc C sÐ d}t jj| rJt| d*}x"|D ]}d|kr"d|kr"d}P q"W W d Q R X |dkrÌd}t jj| rt| d}|j d d }W d Q R X td d
}|j| W d Q R X tjd | tjd tj d d g d S )
Nr rG Zuser_allow_otherú#r zuser_allow_other
ZrtÚ
z/tmp/fuse.conf.tmpZwtz/etc/fuse.confz root:root)
rZ r[ r\ rï r rð r< rÇ rp rT )Z conf_fileÚfoundrù ÚlineÚsZoutfrQ rQ rR Ú fuse_confº s"
r c C sR yÌyt j| dg W n tk
r( Y nX tjj| rtj| }ttj }tt
j }|j |kof|j
|ksÊt j| dtd t
g nHt j| dg t j|dg t j| td t
g t j|td t
g W n, tk
rø } ztj| W Y d d }~X nX dd tjtjD t|t|d}d}tjj d kr8d
}t|| |ddddd d S ) Nz-lz-Rrg z-pc S s& g | ] }t jtjjtj|d dqS )T)Ú
ignore_errors)ÚshutilZrmtreerZ r[ ri rX r# )r$ ÚxrQ rQ rR ú
<listcomp>æ s zmain.<locals>.<listcomp>)rh TrÎ F)Z nothreadsZ
foregroundZnonemptyZ
big_writesZ allow_other)r< rc rb rZ r[ r/ r r r r Ú
FUSE_GROUPr r, r( rT r6 r´ r] rµ ÚlistdirrX r# r r r6 rY r
)Z
mountpointZ cacherootZmountpoint_statrC r r÷ Z tvaultpluginZdisable_fuse_threadsrQ rQ rR ÚmainÍ s@
r c C s2 t t tjt} | jt ttjtj dS )z$Main routine that drives fuse mount.N)
r^ r r r rW Zvalidate_s3_clientr rX r" r# )Z s3backendrQ rQ rR r¸ þ s
r¸ Ú__main__i i )r )or¹ rZ ZgrpÚsysrP rê r rÇ rñ r rT Ú
subprocessrª r r Ztempfiler Úpwdr r r Ú ImportErrorZqueueZ
cachetoolsr Zfuser
r r ZfusepyZs3fuse.bunch_p3ZastZ oslo_configr Z oslo.configZoslo_logr r_ Z s3fuse.utilsr Zs3fuser r Z_DEFAULT_LOG_DATE_FORMATr Z QUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZ
vault_optsrX Z
register_optsZregister_cli_optsr ÚenvironÚflagÚargvZlist_all_sectionsZs3fuse.privsepr< Zsetupr! rY Z getLoggerr] rw r7 ZloggerZsetLevelÚDEBUGÚINFOZWARNra rb r³ rW rm rM rV r^ ZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetpassZgetuserr ZgetgrgidÚgetgidZgr_namer r ri rn rf rm rn ro Úobjectr r rf r r r r¸ r~ rQ rQ rQ rR Ú<module> s
4 $ y
1