o ia@s~ddlZddlZddlZddlZddlZddlmZeeZ GdddZ GdddeZ GdddZ Gd d d eZ dS) N) HTMLParserc@sHeZdZdZddZddZddZdd Zd d Zd d Z ddZ dS) SearchIndexzy Search index is a collection of pages and sections (heading tags and their following content are sections). cKsg|_||_dSN)_entriesconfig)selfrrD/usr/lib/python3/dist-packages/mkdocs/contrib/search/search_index.py__init__s zSearchIndex.__init__cCs>|D]}|j|kr |S||j|}|dur|SqdS)zx Given a table of contents and HTML ID, iterate through and return the matched item in the TOC. N)id_find_toc_by_idchildren)rtocid_toc_item toc_item_rrrr r s zSearchIndex._find_toc_by_idcCsD|dd}tdd|}|j|t|ddd|ddS)zc A simple wrapper to add an entry and ensure the contents is UTF8 encoded.   z[ \t\n\r\f\v]+utf-8)encoding)titletextlocationN)replaceresubstriprappendstrencode)rrrlocrrr _add_entry"s  zSearchIndex._add_entrycCs`t}||j||j}|j|j||jd|d|j D] }| ||j |q#dS)z Create a set of entries in the index for a page. One for the page itself and then one for each of its' heading tags.  rrr N) ContentParserfeedcontentcloseurlr!r strip_tagsrstripdatacreate_entry_for_sectionr)rpageparserr(sectionrrr add_entry_from_context0s  z"SearchIndex.add_entry_from_contextcCs>|||j}|dur|j|jd|j||jddSdS)z Given a section on the page, the table of contents and the absolute url for the page create an entry in the index Nrr#)r r r!rjoinrr()rr/rabs_urlrrrr r,Ls  z$SearchIndex.create_entry_for_sectionc Cs|j|jd}tj|ddd}|jddvrzWtjtjtjt d}t j d|gt j t j t j d }| |d \}}|sct|d rJ|d n|}t||d <tj|ddd}td W|Std|W|Sttfy}ztd|WYd}~|Sd}~ww|S)zpython to json conversion)docsrT),:) sort_keys separatorsprebuild_index)Tnodezprebuild-index.jsr9)stdinstdoutstderrrdecodeindexz,Pre-built search index created successfully.z+Failed to pre-build search index. Error: {}N)rrjsondumpsospathr1dirnameabspath__file__ subprocessPopenPIPE communicaterhasattrr=loadslogdebugwarningformatOSError ValueError)r page_dictsr+ script_pathpidxerrerrr generate_search_index\s8 z!SearchIndex.generate_search_indexcCst}|||S)zstrip html tags from data) HTMLStripperr%get_data)rhtmlsrrr r)zs zSearchIndex.strip_tagsN) __name__ __module__ __qualname____doc__r r r!r0r,rXr)rrrr r s  rcs0eZdZdZfddZddZddZZS)rYz A simple HTML parser that stores all of the data within tags but ignores the tags themselves and thus strips them from the content. cstj|i|g|_dSr)superr r+rargskwargs __class__rr r s zHTMLStripper.__init__cCs|j|dS); Called for the text contents of each tag. N)r+r)rdrrr handle_dataszHTMLStripper.handle_datacCs d|jS)Nr")r1r+)rrrr rZs zHTMLStripper.get_data)r]r^r_r`r rirZ __classcell__rrrer rYs  rYc@s"eZdZdZdddZddZdS)ContentSectionzm Used by the ContentParser class to capture the information we need when it is parsing the HMTL. NcCs|pg|_||_||_dSr)rr r)rrrrrrr r s  zContentSection.__init__cCs&t|j|jk|j|jk|j|jkgSr)allrr r)rotherrrr __eq__s    zContentSection.__eq__)NNN)r]r^r_r`r rnrrrr rks  rkcs8eZdZdZfddZddZddZdd ZZS) r$z Given a block of HTML, group the content under the preceding heading tags which can then be used for creating an index for that section. cs(tj|i|g|_d|_d|_dS)NF)rar r+r/ is_header_tagrbrerr r s zContentParser.__init__cCs^|ddtddDvrdSd|_t|_|j|j|D]}|ddkr,|d|j_qdS) z&Called at the start of every HTML tag.cSg|]}d|qSzh%dr.0xrrr z1ContentParser.handle_starttag..NTrr )rangerorkr/r+rr )rtagattrsattrrrr handle_starttags  zContentParser.handle_starttagcCs&|ddtddDvrdSd|_dS)z$Called at the end of every HTML tag.cSrprqrrrrrr rurvz/ContentParser.handle_endtag..rwrxNF)ryro)rrzrrr handle_endtags zContentParser.handle_endtagcCs8|jdurdS|jr||j_dS|jj|ddS)rgNr")r/rorrrr*)rr+rrr ris  zContentParser.handle_data) r]r^r_r`r r}r~rirjrrrer r$s   r$)rArr?loggingrF html.parserr getLoggerr]rLrrYrkr$rrrr s  u