U ,a5@sdddlmZmZmZGdddejZGdddeZGdddeZGdd d eZ dd d Z d S))grammartokentokenizec@s eZdZdS) PgenGrammarN)__name__ __module__ __qualname__r r 7/opt/alt/python38/lib64/python3.8/lib2to3/pgen2/pgen.pyrsrc@seZdZd&ddZddZddZdd Zd d Zd d ZddZ ddZ ddZ ddZ ddZ ddZddZddZddZd'd d!Zd"d#Zd$d%ZdS)(ParserGeneratorNcCsld}|dkrt|}|j}||_||_t|j|_|| \|_ |_ |dk rZ|i|_ | dSN)openclosefilenamestreamrgenerate_tokensreadline generatorgettokenparsedfas startsymbolfirst addfirstsets)selfrrZ close_streamr r r __init__ szParserGenerator.__init__c Cst}t|j}|||j|d|j|D]&}dt|j }||j |<||j |<q:|D]}|j|}g}|D]`}g}t |j D]$\} } |||| || fq|jr|d||f||q||j|||||f|j|j |<qf|j |j|_|S)N)rlistrkeyssortremoverinsertlen symbol2numberZ number2symbolsortedarcsitemsappend make_labelindexisfinalstates make_firststart) rcnamesnameidfar,stater&labelnextr r r make_grammars.      zParserGenerator.make_grammarcCs4|j|}i}t|D]}|||}d||<q|SNr)rr%r))rr/r1Zrawfirstrr5ilabelr r r r-4s     zParserGenerator.make_firstcCs&t|j}|dr||jkrZ||jkr4|j|S|j|j|df||j|<|Sn>tt|d}||jkrz|j|S|j|df||j|<|Snt |}|dr||j kr|j |S|jtj |f||j |<|Sn>t j |}||jkr|j|S|j|df||j|<|SdSNr)r#labelsisalphar$Z symbol2labelr(getattrrtokensevalkeywordsNAMErZopmap)rr/r5r9Zitokenvaluer r r r)=s6                  zParserGenerator.make_labelcCs8t|j}||D]}||jkr||qdSr )rrrr r calcfirst)rr0r1r r r rks  zParserGenerator.addfirstsetsc Cs|j|}d|j|<|d}i}i}|jD]x\}}||jkr||jkrj|j|}|dkr~td|n|||j|}|||||<q.d||<|di||<q.i} |D]:\}} | D],} | | krtd|| || | f|| | <qq||j|<dS)Nrzrecursion for rule %rrzArule %s is ambiguous; %s is in the first sets of %s as well as %s)rrr&r' ValueErrorrCupdate) rr1r3r4ZtotalsetZ overlapcheckr5r6fsetZinverseZitsfirstZsymbolr r r rCss4          zParserGenerator.calcfirstc Csi}d}|jtjkr|jtjkr*|q|tj}|tjd|\}}|tj| ||}t |}| |t |}|||<|dkr|}q||fS)N:) typer ENDMARKERNEWLINErexpectrAOP parse_rhsmake_dfar# simplify_dfa) rrrr1azr3ZoldlenZnewlenr r r rs"        zParserGenerator.parsec sfdd}fddt|||g}|D]}i}|jD].}|jD]"\}} |dk rD| ||iqDq:t|D]@\}} |D]} | j| krqqt| |} || || |qvq,|S)Ncsi}|||Sr r )r4base addclosurer r closures z)ParserGenerator.make_dfa..closurecs:||kr dSd||<|jD]\}}|dkr||qdSr8r&)r4rRr5r6rSr r rTs z,ParserGenerator.make_dfa..addclosure)DFAStatenfasetr& setdefaultr%r'r(addarc) rr.finishrUr,r4r&Znfastater5r6rXstr rSr rNs"      zParserGenerator.make_dfac Cstd||g}t|D]|\}}td|||kr2dp4d|jD]T\}}||krZ||} nt|} |||dkrtd| q>td|| fq>qdS)NzDump of NFA for State(final)z -> %d %s -> %d)print enumerater&r*r#r() rr1r.r[Ztodor2r4r5r6jr r r dump_nfas   zParserGenerator.dump_nfacCsdtd|t|D]L\}}td||jr*dp,dt|jD]\}}td|||fq>qdS)NzDump of DFA forr]r^r_r`)rarbr+r%r&r'r*)rr1r3r2r4r5r6r r r dump_dfas  zParserGenerator.dump_dfacCspd}|rld}t|D]T\}}t|dt|D]8}||}||kr.||=|D]}|||qLd}qq.qqdS)NTFr)rbranger# unifystate)rr3Zchangesr2Zstate_ircZstate_jr4r r r rOszParserGenerator.simplify_dfacCs~|\}}|jdkr||fSt}t}|||||jdkrr||\}}||||q>||fSdS)N|) parse_altrBNFAStaterZr)rrPrQZaaZzzr r r rMs        zParserGenerator.parse_rhscCsL|\}}|jdks(|jtjtjfkrD|\}}|||}q ||fS)N)([) parse_itemrBrHrrASTRINGrZ)rrPbr/dr r r ri s    zParserGenerator.parse_altcCs|jdkr>||\}}|tjd||||fS|\}}|j}|dkr`||fS||||dkr||fS||fSdS)Nrl])+*rr)rBrrMrKrrLrZ parse_atom)rrPrQrBr r r rms     zParserGenerator.parse_itemcCs|jdkr4||\}}|tjd||fS|jtjtjfkrpt }t }| ||j|||fS| d|j|jdS)Nrk)z+expected (...) or NAME or STRING, got %s/%s) rBrrMrKrrLrHrArnrjrZ raise_error)rrPrQr r r rt(s  zParserGenerator.parse_atomcCsD|j|ks|dk r2|j|kr2|d|||j|j|j}||S)Nzexpected %s/%s, got %s/%s)rHrBrvr)rrHrBr r r rK9szParserGenerator.expectcCsFt|j}|dtjtjfkr*t|j}q |\|_|_|_|_|_ dSr:) r6rrCOMMENTNLrHrBZbeginendline)rtupr r r rAs  zParserGenerator.gettokenc Gs^|r8z ||}Wn&d|gttt|}YnXt||j|jd|jd|jfdS)N rr)joinrmapstr SyntaxErrorrryrz)rmsgargsr r r rvHs  zParserGenerator.raise_error)N)N)rrrrr7r-r)rrCrrNrdrerOrMrirmrtrKrrvr r r r r s$  .$  r c@seZdZddZdddZdS)rjcCs g|_dSr rV)rr r r rSszNFAState.__init__NcCs|j||fdSr )r&r(rr6r5r r r rZVszNFAState.addarc)N)rrrrrZr r r r rjQsrjc@s0eZdZddZddZddZddZd Zd S) rWcCs||_||k|_i|_dSr )rXr+r&)rrXfinalr r r r]s zDFAState.__init__cCs||j|<dSr rVrr r r rZeszDFAState.addarccCs*|jD]\}}||kr ||j|<q dSr )r&r')roldnewr5r6r r r rgkszDFAState.unifystatecCsV|j|jkrdSt|jt|jkr(dS|jD]\}}||j|k r2dSq2dS)NFT)r+r#r&r'get)rotherr5r6r r r __eq__ps zDFAState.__eq__N)rrrrrZrgr__hash__r r r r rW[s rW Grammar.txtcCst|}|Sr )r r7)rpr r r generate_grammarsrN)r) r_rrrZGrammarrobjectr rjrWrr r r r sI %