Why Gemfury?
Push, build, and install
RubyGems
npm packages
Python packages
Maven artifacts
PHP packages
Go Modules
Debian packages
RPM packages
NuGet packages
doctorondemand
doctorondemand / Pygments python
Repository URL to install this package:
|
Version:
2.5.0 ▾
|
]q (cpygments.token
_TokenType
qX CommentqX Multilineqq
qq}q(X subtypesqcbuiltins
set
q ]q
q Rq X parentq
hh
q
qq}q(hh ]q(hhX Preprocqq
qq}q(hh ]q
qRqh
hubhhX Multiqq
q q }q (hh ]q
q!Rq"h
hubhhX Hashbangq#q$
q%q&}q'(hh ]q(
q)Rq*h
hubhhX Singleq+q,
q-q.}q/(hh ]q0
q1Rq2h
hubhhX
SingleLineq3q4
q5q6}q7(hh ]q8
q9Rq:h
hubhhX Docq;q<
q=q>}q?(hh ]q@
qARqBh
hubhhX DirectiveqCqD
qEqF}qG(hh ]qH
qIRqJh
hubhhhX
SinglelineqKqL
qMqN}qO(hh ]qP
qQRqRh
hubhhX PreprocFileqSqT
qUqV}qW(hh ]qX
qYRqZh
hubhhX Specialq[q\
q]q^}q_(hh ]q`
qaRqbh
hube
qcRqdh
h)
qeqf}qg(hh ]qh(hX Escapeqi
qj
qkql}qm(hh ]qn
qoRqph
hfubhX Operatorqq
qr
qsqt}qu(hh ]qv(hhqX DBSqwqx
qyqz}q{(hh ]q|
q}Rq~h
htubhhqX Wordqq
qq}q(hh ]q
q
Rqh
htube
qRqh
hfhhhwhzubhX Nameq
q
qq}q(hh ]q(hhX Tagqq
qq}q(hh ]q
qRqh
hubhhX Entityqq
qq}q(hh ]qhhhhwq
qq}q (hh ]q¡
q¢Rq£h
huba
q¤Rq¥h
hhwhubhhX Exceptionq¦q§
q¨q©}qª(hh ]q«
q¬Rqh
hubhhX Decoratorq®q¯
q°q±}q²(hh ]q³
q´Rqµh
hubhhX Classq¶q·
q¸q¹}qº(hh ]q»(hhh¶hwq¼
q½q¾}q¿(hh ]qqÁRqÂh
h¹ubhhh¶X StartqÇqąqŁqÆ}qÇ(hh ]qȅqÉRqÊh
h¹ube
qËRqÌh
hhÃhÆhwh¾ubhhX Variableq͆q΅qρqÐ}qÑ(hh ]qÒ(hhhÍX AnonymousqӇqԅqՁqÖ}q×(hh ]qqÙRqÚh
hÐubhhhÍh¶qۅq܁qÝ}qÞ(hh ]q߅qàRqáh
hÐubhhhÍX Magicqâqã
qäqå}qæ(hh ]qç
qèRqéh
hÐubhhhÍX Globalqêqë
qìqí}qî(hh ]qï
qðRqñh
hÐubhhhÍX Instanceqòqó
qôqõ}qö(hh ]q÷
qøRqùh
hÐube
qúRqûh
hh¶hÝhêhíhòhõhâhåhÓhÖubhhX Attributeqüqý
qþqÿ}r (hh ]r hhhüh͇r
r r }r (hh ]r
r Rr h
hÿuba
r Rr
h
hhÍj ubhhX Namespacer r
r
r }r (hh ]r
r Rr h
hubhhX Propertyr r
r r }r (hh ]r
r Rr h
hubhhX Symbolr r
r r }r (hh ]r
r! Rr" h
hubhhX Classesr# r$
r% r& }r' (hh ]r(
r) Rr* h
hubhhX Pseudor+ r,
r- r. }r/ (hh ]r0
r1 Rr2 h
hubhhX Labelr3 r4
r5 r6 }r7 (hh ]r8
r9 Rr: h
hubhhhqr;
r< r= }r> (hh ]r?
r@ RrA h
hubhhX BuiltinrB rC
rD rE }rF (hh ]rG (hhjB j+ rH
rI rJ }rK (hh ]rL
rM RrN h
jE ubhhjB X TyperO rP
rQ rR }rS (hh ]rT
rU RrV h
jE ube
rW RrX h
hj+ jJ jO jR ubhhX FieldrY rZ
r[ r\ }r] (hh ]r^
r_ Rr` h
hubhhX Otherra rb
rc rd }re (hh ]rf hhja X Memberrg rh
ri rj }rk (hh ]rl
rm Rrn h
jd uba
ro Rrp h
hjg jj ubhhX Functionrq rr
rs rt }ru (hh ]rv hhjq hârw
rx ry }rz (hh ]r{
r| Rr} h
jt uba
r~ Rr h
hhâjy ubhhjO r
r r }r (hh ]r
r
Rr h
hubhhX Constantr r
r r }r (hh ]r
r Rr h
hube
r Rr h
hfhühÿjB jE h¶h¹j j h®h±hhh¦h©jq jt j j j3 j6 j j ja jd hhhÍhÐjY j\ j j j+ j. hqj= j# j& jO j ubhX Literalr
r
r r }r (hh ]r (hj ja r
r r }r (hh ]r
r Rr h
j ubhj X Charr r
r r¡ }r¢ (hh ]r£
r¤ Rr¥ h
j ubhj X Dater¦ r§
r¨ r© }rª (hh ]r«
r¬ Rr h
j ubhj X Scalarr® r¯
r° r± }r² (hh ]r³ hj j® X Plainr´ rµ
r¶ r· }r¸ (hh ]r¹
rº Rr» h
j± uba
r¼ Rr½ h
j j´ j· ubhj X Stringr¾ r¿
rÀ rÁ }r (hh ]rà (hj j¾ X InterpolrÄ rÅ
rÆ rÇ }rÈ (hh ]rÉ
rÊ RrË h
jÁ ubhj j¾ X DelimeterrÌ rÍ
rÎ rÏ }rÐ (hh ]rÑ
rÒ RrÓ h
jÁ ubhj j¾ j rÔ
rÕ rÖ }r× (hh ]rØ
rÙ RrÚ h
jÁ ubhj j¾ j rÛ
rÜ rÝ }rÞ (hh ]rß
rà Rrá h
jÁ ubhj j¾ h+râ
rã rä }rå (hh ]ræ
rç Rrè h
jÁ ubhj j¾ ja ré
rê rë }rì (hh ]rí
rî Rrï h
jÁ ubhj j¾ X Backtickrð rñ
rò ró }rô (hh ]rõ
rö Rr÷ h
jÁ ubhj j¾ hirø
rù rú }rû (hh ]rü
rý Rrþ h
jÁ ubhj j¾ X Regexrÿ r
r r }r (hh ]r
r Rr h
jÁ ubhj j¾ X Momentr r
r r
}r (hh ]r
r
Rr h
jÁ ubhj j¾ X Booleanr r
r r }r (hh ]r
r Rr h
jÁ ubhj j¾ X Characterr r
r r }r (hh ]r
r Rr h
jÁ ubhj j¾ X Delimiterr r
r! r" }r# (hh ]r$
r% Rr& h
jÁ ubhj j¾ h;r'
r( r) }r* (hh ]r+
r, Rr- h
jÁ ubhj j¾ hr.
r/ r0 }r1 (hh ]r2
r3 Rr4 h
jÁ ubhj j¾ X Affixr5 r6
r7 r8 }r9 (hh ]r:
r; Rr< h
jÁ ubhj j¾ X Heredocr= r>
r? r@ }rA (hh ]rB
rC RrD h
jÁ ubhj j¾ X DoublerE rF
rG rH }rI (hh ]rJ
rK RrL h
jÁ ubhj j¾ X InterprM rN
rO rP }rQ (hh ]rR
rS RrT h
jÁ ubhj j¾ X AtomrU rV
rW rX }rY (hh ]rZ
r[ Rr\ h
jÁ ube
r] Rr^ h
j j5 j8 jð jó j jÖ j j" h;j) jE jH hijú j= j@ jÄ jÇ ja jë jÿ j h+jä j jÝ j j j j
jM jP j j jÌ jÏ jU jX hj0 ubhj X Numberr_ r`
ra rb }rc (hh ]rd (hj j_ X Floatre rf
rg rh }ri (hh ]rj
rk Rrl h
jb ubhj j_ X Decrm rn
ro rp }rq (hh ]rr
rs Rrt h
jb ubhj j_ X Radixru rv
rw rx }ry (hh ]rz
r{ Rr| h
jb ubhj j_ X Octr} r~
r r }r (hh ]r
r Rr h
jb ubhj j_ X Binr
r
r r }r (hh ]r
r Rr h
jb ubhj j_ hür
r r }r (hh ]r
r Rr h
jb ubhj j_ X Hexr r
r r }r (hh ]r
r Rr h
jb ubhj j_ X Integerr r
r r }r (hh ]r¡ h(j j_ j X Longr¢ tr£
r¤ r¥ }r¦ (hh ]r§
r¨ Rr© h
j uba
rª Rr« h
jb j¢ j¥ ubhj j_ X Decimalr¬ r
r® r¯ }r° (hh ]r±
r² Rr³ h
jb ube
r´ Rrµ h
j j
j je jh j j j j j} j ju jx hüj j¬ j¯ jm jp ube
r¶ Rr· h
hfj¾ jÁ j_ jb j¦ j© j® j± ja j j j¡ ubhX Genericr¸
r¹
rº r» }r¼ (hh ]r½ (hj¸ X Errorr¾ r¿
rÀ rÁ }r (hh ]rÃ
rÄ RrÅ h
j» ubhj¸ X
SubheadingrÆ rÇ
rÈ rÉ }rÊ (hh ]rË
rÌ RrÍ h
j» ubhj¸ X TracebackrÎ rÏ
rÐ rÑ }rÒ (hh ]rÓ
rÔ RrÕ h
j» ubhj¸ X OutputrÖ r×
rØ rÙ }rÚ (hh ]rÛ
rÜ RrÝ h
j» ubhj¸ X PromptrÞ rß
rà rá }râ (hh ]rã
rä Rrå h
j» ubhj¸ X Deletedræ rç
rè ré }rê (hh ]rë
rì Rrí h
j» ubhj¸ X Insertedrî rï
rð rñ }rò (hh ]ró
rô Rrõ h
j» ubhj¸ X Headingrö r÷
rø rù }rú (hh ]rû
rü Rrý h
j» ubhj¸ X Strongrþ rÿ
r r }r (hh ]r
r Rr h
j» ubhj¸ X Emphr r
r r }r
(hh ]r
r Rr
h
j» ube
r Rr h
hfjæ jé j j j¾ jÁ jö jù jî jñ jÖ jÙ jÞ já jþ j jÆ jÉ jÎ jÑ ubhj¾
r
r r }r (hh ]r
r Rr h
hfubhX Keywordr
r
r r }r (hh ]r (hj hr
r r }r (hh ]r!
r" Rr# h
j ubhj j r$
r% r& }r' (hh ]r(
r) Rr* h
j ubhj jO r+
r, r- }r. (hh ]r/
r0 Rr1 h
j ubhj X PreProcr2 r3
r4 r5 }r6 (hh ]r7
r8 Rr9 h
j ubhj X Controlr: r;
r< r= }r> (hh ]r?
r@ RrA h
j ubhj j rB
rC rD }rE (hh ]rF
rG RrH h
j ubhj j rI
rJ rK }rL (hh ]rM
rN RrO h
j ubhj j+ rP
rQ rR }rS (hh ]rT
rU RrV h
j ubhj X DeclarationrW rX
rY rZ }r[ (hh ]r\
r] Rr^ h
j ubhj X Reservedr_ r`
ra rb }rc (hh ]rd
re Rrf h
j ube
rg Rrh h
hfj jD jW jZ j jK j+ jR j_ jb jO j- j: j= j j& j2 j5 hj ubhja
ri
rj rk }rl (hh ]rm
rn Rro h
hfubhX Textrp
rq
rr rs }rt (hh ]ru (hjp X Rootrv rw
rx ry }rz (hh ]r{
r| Rr} h
js ubhjp j r~
r r }r (hh ]r
r Rr h
js ubhjp X Ragr
r
r r }r (hh ]r
r Rr h
js ubhjp X
Whitespacer r
r r }r (hh ]r
r Rr h
js ubhjp X Beerr r
r r }r (hh ]r
r Rr h
js ubhjp X Punctuationr r
r r }r¡ (hh ]r¢
r£ Rr¤ h
js ube
r¥ Rr¦ h
hfj j j j j j jv jy j j j
j ubhhj
r§
r¨ r© }rª (hh ]r« hj X Indicatorr¬ r
r® r¯ }r° (hh ]r±
r² Rr³ h
j© uba
r´ Rrµ h
hfj¬ j¯ ube
r¶ Rr· jp js hihlj¾ j ja jk j j hhj j j j© hqhthhj¸ j» X Tokenr¸ hfj¾ jÁ j_ jb ubh#h&hhhhhShVh+h.h[h^hChFh3h6h;h>hh hKhNububX /**
* This script is an example recommender (using made up data) showing how you might modify item-item links
* by defining similar relations between items in a dataset and customizing the change in weighting.
* This example creates metadata by using the genre field as the metadata_field. The items with
* the same genre have it's weight cut in half in order to boost the signals of movies that do not have the same genre.
* This technique requires a customization of the standard GetItemItemRecommendations macro
*/r¹ rº js X
r» r¼ j X importr½ r¾ js X r¿ rÀ jÁ X 'recommenders.pig'rÁ r j© X ;rà rÄ js X
rÅ rÆ j X %defaultrÇ rÈ js j¿ rÉ js X INPUT_PATH_PURCHASESrÊ rË js j¿ rÌ jÁ X '../data/retail/purchases.json'rÍ rÎ js j» rÏ j X %defaultrÐ rÑ js j¿ rÒ js X INPUT_PATH_WISHLISTrÓ rÔ js j¿ rÕ jÁ X '../data/retail/wishlists.json'rÖ r× js j» rØ j X %defaultrÙ rÚ js j¿ rÛ js X INPUT_PATH_INVENTORYrÜ rÝ js j¿ rÞ jÁ X '../data/retail/inventory.json'rß rà js j» rá j X %defaultrâ rã js j¿ rä js X OUTPUT_PATHrå ræ js j¿ rç jÁ X% '../data/retail/out/modify_item_item'rè ré js X
rê rë hX6 /******** Custom GetItemItemRecommnedations *********/rì rí js j» rî j X definerï rð js j¿ rñ jt X/ recsys__GetItemItemRecommendations_ModifyCustomrò ró j© X (rô rõ js X user_item_signals,rö r÷ js j¿ rø js X metadatarù rú j© X )rû rü js j¿ rý j X returnsrþ rÿ js j¿ r js X item_item_recsr r js j¿ r j© X {r r js X
r r hX2 -- Convert user_item_signals to an item_item_graphr r js X
r
r js X
ii_links_raw,r r
js j¿ r js X item_weightsr r js X r r htX =r r js X r r jt X recsys__BuildItemItemGraphr r j© jô r js X(
r r js X $user_item_signals,r r js X(
r r js X $LOGISTIC_PARAM,r r! js X(
r" r# js X $MIN_LINK_WEIGHT,r$ r% js X(
r& r' js X $MAX_LINKS_PER_USERr( r) js X&
r* r+ j© jû r, j© jà r- js X
r. r/ hXP -- NOTE this function is added in order to combine metadata with item-item linksr0 r1 js X
r2 r3 hX* -- See macro for more detailed explinationr4 r5 js X
r6 r7 js X ii_links_metadatar8 r9 js X r: r; htj r< js X r= r> jt X" recsys__AddMetadataToItemItemLinksr? r@ j© jô rA js X)
rB rC js X
ii_links_raw,rD rE js X)
rF rG js X $metadatarH rI js X%
rJ rK j© jû rL j© jà rM js X
rN rO hX, /********* Custom Code starts here ********/rP rQ js X
rR rS hXb --The code here should adjust the weights based on an item-item link and the equality of metadata.rT rU js X
rV rW hXi -- In this case, if the metadata is the same, the weight is reduced. Otherwise the weight is left alone.rX rY js X
rZ r[ js X ii_links_adjustedr\ r] js X r^ r_ htj r` js X ra rb j X foreachrc rd js j¿ re js X ii_links_metadatarf rg js j¿ rh j X generateri rj js j¿ rk js X item_A,rl rm js j¿ rn js X item_B,ro rp js X)
rq rr hXX -- the amount of weight adjusted is dependant on the domain of data and what is expectedrs rt js X)
ru rv hXl -- It is always best to adjust the weight by multiplying it by a factor rather than addition with a constantrw rx js X)
ry rz j© jô r{ js X
metadata_Br| r} js j¿ r~ htj r htj r js j¿ r js X
metadata_Ar r js j¿ r htX ?r
r js j¿ r j© jô r js X weightr r js j¿ r js X *r r js j¿ r jh X 0.5r r j© jû r js X :r r js j¿ r js X weightr r j© jû r js j¿ r j X asr r js j¿ r js X weight;r r js X
r r hX+ /******** Custom Code stops here *********/r r¡ js X
r¢ r£ hX& -- remove negative numbers just incaser¤ r¥ js X
r¦ r§ js X ii_links_adjusted_filtr¨ r© js j¿ rª htj r« js j¿ r¬ j X foreachr r® js j¿ r¯ js X ii_links_adjustedr° r± js j¿ r² j X generater³ r´ js j¿ rµ js X item_A,r¶ r· js j¿ r¸ js X item_B,r¹ rº js X'
r» r¼ j© jô r½ js X weightr¾ r¿ js j¿ rÀ htX <=rÁ r js j¿ rà j X 0rÄ rÅ js j¿ rÆ htj
rÇ js j¿ rÈ j jÄ rÉ js j rÊ js j¿ rË js X weightrÌ rÍ j© jû rÎ js j¿ rÏ j X asrÐ rÑ js j¿ rÒ js X weight;rÓ rÔ js X
rÕ rÖ hX> -- Adjust the weights of the graph to improve recommendations.r× rØ js X
rÙ rÚ js X ii_linksrÛ rÜ js X rÝ rÞ htj rß js X rà rá jt X! recsys__AdjustItemItemGraphWeightrâ rã j© jô rä js X)
rå ræ js X ii_links_adjusted_filt,rç rè js X)
ré rê js X
item_weights,rë rì js X)
rí rî js X $BAYESIAN_PRIORrï rð js X%
rñ rò j© jû ró j© jà rô js X
rõ rö hX? -- Use the item-item graph to create item-item recommendations.r÷ rø js X
rù rú js X $item_item_recsrû rü js j¿ rý htj rþ js X rÿ r jt X- recsys__BuildItemItemRecommendationsFromGraphr r j© jô r js X
r r js X ii_links,r r js X
r r js X $NUM_RECS_PER_ITEM,r
r js X
r r
js X $NUM_RECS_PER_ITEMr r js X
r r j© jû r j© jà r js j» r j© X }r r j© jà r js X
r r hX /******* Load Data **********/r r js X
r r hX --Get purchase signalsr r js j» r js X purchase_inputr! r" js j¿ r# htj r$ js j¿ r% j X loadr& r' js j¿ r( jÁ X '$INPUT_PATH_PURCHASES'r) r* js j¿ r+ j X usingr, r- js j¿ r. js X+ org.apache.pig.piggybank.storage.JsonLoaderr/ r0 j© jô r1 js X
r2 r3 js X 'row_id: r4 r5 j- X intr6 r7 htX ,r8 r9 js X
r: r; js X movie_idr< r= js j r> js j¿ r? j- X chararrayr@ rA htj8 rB js X
rC rD js X
movie_namerE rF js j rG js j¿ rH j- X chararrayrI rJ htj8 rK js X
rL rM js X user_idrN rO js j rP js j¿ rQ j- X chararrayrR rS htj8 rT js X
rU rV js X purchase_pricerW rX js j rY js j¿ rZ j- X intr[ r\ js X ');
r] r^ hX --Get wishlist signalsr_ r` js j» ra js X wishlist_inputrb rc js j¿ rd htj re js X rf rg j X loadrh ri js j¿ rj jÁ X '$INPUT_PATH_WISHLIST'rk rl js j¿ rm j X usingrn ro js j¿ rp js X+ org.apache.pig.piggybank.storage.JsonLoaderrq rr j© jô rs js X
rt ru js X 'row_id: rv rw j- X intrx ry htj8 rz js X
r{ r| js X movie_idr} r~ js j r js j¿ r j- X chararrayr r htj8 r js X
r r
js X
movie_namer r js j r js j¿ r j- X chararrayr r htj8 r js X
r r js X user_idr r js j r js j¿ r j- X chararrayr r js X ');
r r hX, /******* Convert Data to Signals **********/r r js X
r r hX4 -- Start with choosing 1 as max weight for a signal.r r js j» r js X purchase_signalsr r js j¿ r htj r¡ js j¿ r¢ j X foreachr£ r¤ js j¿ r¥ js X purchase_inputr¦ r§ js j¿ r¨ j X generater© rª js X
r« r¬ js X user_idr r® js X r¯ r° j X asr± r² js j¿ r³ js X user,r´ rµ js X
r¶ r· js X
movie_namer¸ r¹ js j¿ rº j X asr» r¼ js j¿ r½ js X item,r¾ r¿ js X
rÀ rÁ jh X 1.0r rà js X rÄ rÅ j X asrÆ rÇ js j¿ rÈ js X weight;rÉ rÊ js X
rË rÌ hX\ -- Start with choosing 0.5 as weight for wishlist items because that is a weaker signal thanrÍ rÎ js j» rÏ hX -- purchasing an item.rÐ rÑ js j» rÒ js X wishlist_signalsrÓ rÔ js j¿ rÕ htj rÖ js j¿ r× j X foreachrØ rÙ js j¿ rÚ js X wishlist_inputrÛ rÜ js j¿ rÝ j X generaterÞ rß js X
rà rá js X user_idrâ rã js X rä rå j X asræ rç js j¿ rè js X user,ré rê js X
rë rì js X
movie_namerí rî js j¿ rï j X asrð rñ js j¿ rò js X item,ró rô js X
rõ rö jh X 0.5r÷ rø js X rù rú j X asrû rü js j¿ rý js X weight;rþ rÿ js X
r r js X user_signalsr r js j¿ r htj r js j¿ r j X unionr r js j¿ r js X purchase_signals,r
r js j¿ r js X wishlist_signals;r
r js X
r r hX7 /******** Changes for Modifying item-item links ******/r r js j» r js X inventory_inputr r js j¿ r htj r js j¿ r j X loadr r js j¿ r jÁ X '$INPUT_PATH_INVENTORY'r r js j¿ r j X usingr r js j¿ r! js X+ org.apache.pig.piggybank.storage.JsonLoaderr" r# j© jô r$ js X
r% r& js X 'movie_title: r' r( j- X chararrayr) r* htj8 r+ js X
r, r- js X genresr. r/ js j r0 js j¿ r1 j X bagr2 r3 j© j r4 j- X tupler5 r6 j© jô r7 js X contentr8 r9 js j r: j- X chararrayr; r< j© jû r= j© j r> js X ');
r? r@ js X metadatarA rB js j¿ rC htj rD js j¿ rE j X foreachrF rG js j¿ rH js X inventory_inputrI rJ js j¿ rK j X generaterL rM js X
rN rO j X FLATTENrP rQ j© jô rR js X genresrS rT j© jû rU js j¿ rV j X asrW rX js j¿ rY js X metadata_field,rZ r[ js X
r\ r] js X movie_titler^ r_ js j¿ r` j X asra rb js j¿ rc js X item;rd re js j» rf hX. -- requires the macro to be written seperatelyrg rh js X
ri rj hX9 --NOTE this macro is defined within this file for clarityrk rl js j» rm js X item_item_recsrn ro js j¿ rp htj rq js j¿ rr jt X/ recsys__GetItemItemRecommendations_ModifyCustomrs rt j© jô ru js X
user_signals,rv rw js j¿ rx js X metadatary rz j© jû r{ j© jà r| js j» r} hX" /******* No more changes ********/r~ r js X
r r js X user_item_recsr r js j¿ r htj r
js j¿ r jt X" recsys__GetUserItemRecommendationsr r j© jô r js X
user_signals,r r js j¿ r js X item_item_recsr r j© jû r j© jà r js X
r r hX/ --Completely unrelated code stuck in the middler r js j» r js X datar r js X r r htj r js X r r j X LOADr r js j¿ r jÁ X& 's3n://my-s3-bucket/path/to/responses'r r¡ js X
r¢ r£ j X USINGr¤ r¥ js j¿ r¦ js X+ org.apache.pig.piggybank.storage.JsonLoaderr§ r¨ j© jô r© j© jû rª j© jà r« js j» r¬ js X responsesr r® js X r¯ r° htj r± js X r² r³ j X FOREACHr´ rµ js j¿ r¶ js X datar· r¸ js j¿ r¹ j X GENERATErº r» js j¿ r¼ js X objectr½ r¾ htX #r¿ rÀ jÁ X
'response'rÁ r js j¿ rà j X ASrÄ rÅ js j¿ rÆ js X responserÇ rÈ js j rÉ js j¿ rÊ j X maprË rÌ j© X [rÍ rÎ j© X ]rÏ rÐ j© jà rÑ js j» rÒ js X outrÓ rÔ js X rÕ rÖ htj r× js X rØ rÙ j X FOREACHrÚ rÛ js j¿ rÜ js X responsesrÝ rÞ js X
rß rà j X GENERATErá râ js j¿ rã js X responserä rå htj¿ ræ jÁ X 'id'rç rè js j¿ ré j X ASrê rë js j¿ rì js X idrí rî js j rï js j¿ rð j- X intrñ rò htj8 ró js j¿ rô js X responserõ rö htj¿ r÷ jÁ X 'thread'rø rù js j¿ rú j X ASrû rü js j¿ rý js X threadrþ rÿ js j r js j¿ r j- X chararrayr r htj8 r js X
r r js X responser r htj¿ r jÁ X
'comments'r
r js j¿ r j X ASr
r js j¿ r js X commentsr r js j r js j¿ r j© j r js X tr r js j r js j¿ r j© jô r js X commentr r js j r js j¿ r j- X chararrayr r j© jû r j© j r! j© jà r" js j» r# j X STOREr$ r% js j¿ r& js X outr' r( js j¿ r) j X INTOr* r+ js j¿ r, jÁ X 's3n://path/to/output'r- r. js j¿ r/ j X USINGr0 r1 js j¿ r2 jE X
PigStorager3 r4 j© jô r5 jÁ X '|'r6 r7 j© jû r8 j© jà r9 js X
r: r; hX* /******* Store recommendations **********/r< r= js X
r> r? hXQ -- If your output folder exists already, hadoop will refuse to write data to it.r@ rA js X
rB rC j X rmfrD rE js j¿ rF js X $OUTPUT_PATH/item_item_recs;rG rH js j» rI j X rmfrJ rK js j¿ rL js X $OUTPUT_PATH/user_item_recs;rM rN js X
rO rP j X storerQ rR js j¿ rS js X item_item_recsrT rU js j¿ rV j X intorW rX js j¿ rY jÁ X '$OUTPUT_PATH/item_item_recs'rZ r[ js j¿ r\ j X usingr] r^ js j¿ r_ jE X
PigStorager` ra j© jô rb j© jû rc j© jà rd js j» re j X storerf rg js j¿ rh js X user_item_recsri rj js j¿ rk j X intorl rm js j¿ rn jÁ X '$OUTPUT_PATH/user_item_recs'ro rp js j¿ rq j X usingrr rs js j¿ rt jE X
PigStorageru rv j© jô rw j© jû rx j© jà ry js X
rz r{ hX' -- STORE the item_item_recs into dynamor| r} js j» r~ j X STOREr r js j¿ r js X item_item_recsr r js X
r r
j X INTOr r js j¿ r jÁ X# '$OUTPUT_PATH/unused-ii-table-data'r r js j» r j X USINGr r js j¿ r js X* com.mortardata.pig.storage.DynamoDBStorager r j© jô r jÁ X '$II_TABLE'r r htj8 r js j¿ r jÁ X '$AWS_ACCESS_KEY_ID'r r htj8 r js j¿ r jÁ X '$AWS_SECRET_ACCESS_KEY'r r j© jû r j© jà r js X
r r hX' -- STORE the user_item_recs into dynamor r¡ js j» r¢ j X STOREr£ r¤ js j¿ r¥ js X user_item_recsr¦ r§ js X
r¨ r© j X INTOrª r« js j¿ r¬ jÁ X# '$OUTPUT_PATH/unused-ui-table-data'r r® js j» r¯ j X USINGr° r± js j¿ r² js X* com.mortardata.pig.storage.DynamoDBStorager³ r´ j© jô rµ jÁ X '$UI_TABLE'r¶ r· htj8 r¸ js j¿ r¹ jÁ X '$AWS_ACCESS_KEY_ID'rº r» htj8 r¼ js j¿ r½ jÁ X '$AWS_SECRET_ACCESS_KEY'r¾ r¿ j© jû rÀ j© jà rÁ js j» r e.