o blA@sjdZddlZddlZddlmZddlmZmZddlm Z m Z m Z ddl m Z mZmZmZddlmZddlmZmZdd lmZmZdd lmZdd lmZdd lmZdd lm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(m)Z)m*Z*ddl+m,Z,m-Z-ddl.m/Z/m0Z0GdddZ1ee j2GdddeZ3Gddde/Z4GdddZ5Gddde0Z6dS)z- Tests for L{twisted.trial._dist.disttrial}. N)StringIO) implementerverify)error interfacesreactor)fail gatherResults maybeDeferredsucceed)CONNECTION_DONE)ProcessProtocolProtocol) Cooperator deferLater)Failure)FilesystemLock)MemoryReactorClock) FakeScheduler) DistReporter)DistTrialRunner) LocalWorker)Reporter TreeReporterUncleanWarningsReporterWrapper) ErrorHolder TrialSuite)SynchronousTestCaseTestCasec@eZdZdZddZdS) FakeTransportz* A simple fake process transport. cCdS)z% Ignore write calls. N)selffddatar"r"I/usr/lib/python3/dist-packages/twisted/trial/_dist/test/test_disttrial.py writeToChild(szFakeTransport.writeToChildN)__name__ __module__ __qualname____doc__r'r"r"r"r&r # r c@sLeZdZdZdZdZdZddZdidddddfddZd d Z d d Z dS) CountingReactorz A fake reactor that counts the calls to L{IReactorCore.run}, L{IReactorCore.stop}, and L{IReactorProcess.spawnProcess}. rcCst|||_dSN)r__init___workers)r#workersr"r"r&r/9s  zCountingReactor.__init__r"Nc Cs*|j||t|jd7_dS)z See L{IReactorProcess.spawnProcess}. @param workerProto: See L{IReactorProcess.spawnProcess}. @param args: See L{IReactorProcess.spawnProcess}. @param kwargs: See L{IReactorProcess.spawnProcess}. N)r0appendmakeConnectionr spawnCount) r# workerProto executableargsenvpathuidgidusePTYchildFDsr"r"r& spawnProcess=s  zCountingReactor.spawnProcesscCst||jd7_dS)z+ See L{IReactorCore.stop}. r2N)rstop stopCountr#r"r"r&r@Ts zCountingReactor.stopcCs>|jd7_d|_d|_|jD] \}}}||i|qdS)z* See L{IReactorCore.run}. r2TN)runCountrunninghasRunwhenRunningHooks)r#fr8kwargsr"r"r&run[s zCountingReactor.run) r(r)r*r+r5rArCr/r?r@rIr"r"r"r&r-.s   r-c@s8eZdZdZddZddZddZdd Zd d Zd S) CountingReactorTestsz' Tests for L{CountingReactor}. cCsg|_t|j|_dSr.)r1r-rrBr"r"r&setUpnszCountingReactorTests.setUpcCsttj|jdS)zJ L{CountingReactor} instances provide L{IReactorProcess}. N)r verifyObjectrIReactorProcessrrBr"r"r&test_providesIReactorProcessrsz1CountingReactorTests.test_providesIReactorProcesscCsj||jjt}dD]&}|jj|tjtjgd||j| |j |g|| |jj|q dS)z The process protocol for a spawned process is connected to a transport and appended onto the provided C{workers} list, and the reactor's C{spawnCount} increased. r2r8N) assertFalserr5rr?sysr7 assertTrue transport assertEqualr1)r#protocountr"r"r&test_spawnProcessxs z&CountingReactorTests.test_spawnProcesscCs6||jjdD]}|j||jj|q dS)zB Stopping the reactor increments its C{stopCount} rON)rRrrAr@rV)r#rXr"r"r& test_stops  zCountingReactorTests.test_stopcCsj||jjg}|j|jddD]}|j||jj|||jjd|t||qdS)z Running the reactor increments its C{runCount}, does not imply C{stop}, and calls L{IReactorCore.callWhenRunning} hooks. NrOr) rRrrCcallWhenRunningr3rIrVrAlen)r#whenRunningCallsrXr"r"r&test_runs zCountingReactorTests.test_runN) r(r)r*r+rKrNrYrZr^r"r"r"r&rJis rJc@r)"EternalTerminationPredicateFactoryzI A rigged terminationPredicateFactory for which time never pass. cCr!)z% See: L{task._Timer} Fr"rBr"r"r&__call__sz+EternalTerminationPredicateFactory.__call__N)r(r)r*r+r`r"r"r"r&r_r,r_c@seZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ ddZ ddZ ddZddZddZddZddZd d!Zd"S)#DistTrialRunnerTestsz' Tests for L{DistTrialRunner}. cCs$ttdg|d|_t|j_dS)z. Create a runner for testing. )workingDirectoryN)rrmktemprunnerr_streamrBr"r"r&rKs zDistTrialRunnerTests.setUpcCs.|D]}|jtjtj|ttqdS)z Reap the workers and trap L{ConnectionDone} failures on their C{endDeferred}s. @param workers: The workers to reap. @type workers: An iterable of L{LocalWorker} N) endDeferred addErrbackrtraprConnectionDone processEndedr )r#r1workerr"r"r&reaps zDistTrialRunnerTests.reapcCst}t|td}||fS)a Helper to create fake scheduler and cooperator in tests. The cooperator has a termination timer which will never inform the scheduler that the task needs to be terminated. @return: L{tuple} of (scheduler, cooperator) ) schedulerterminationPredicateFactory)rrr_)r#rn cooperatorr"r"r&$getFakeSchedulerAndEternalCooperators  z9DistTrialRunnerTests.getFakeSchedulerAndEternalCooperatorcCs4t}tt|}|j|||dkdS)ze L{DistTrialRunner.writeResults} writes to the stream specified in the init. rN)rrrre writeResultsrTtell)r#stringIOresultr"r"r&test_writeResultss  z&DistTrialRunnerTests.test_writeResultscCsJddtdD}|j|d}|D]}||tq|dt|dS)zv C{createLocalWorkers} iterates the list of protocols and create one L{LocalWorker} for each. cSg|]}tqSr")object).0xr"r"r& z@DistTrialRunnerTests.test_createLocalWorkers..rbr:N)rangerecreateLocalWorkersassertIsInstancerrVr\)r# protocolsr1sr"r"r&test_createLocalWorkerss z,DistTrialRunnerTests.test_createLocalWorkerscsddtdD}gididddddffdd }|j||d g|dd |tjd |d d |tj t jd dS)z Given a C{spawnProcess} function, C{launchWorkerProcess} launches a python process with an existing path as its argument. cSrwr")r )ryir"r"r&r{r|zCDistTrialRunnerTests.test_launchWorkerProcesses..rbr"Nrc s"|||dSr.)r3extendupdate) processProtocolr7r8r9r:r;r<r=r> arguments environmentr"r&fakeSpawnProcesss zIDistTrialRunnerTests.test_launchWorkerProcesses..fakeSpawnProcessfoor2rPTRIAL_PYTHONPATH) r}relaunchWorkerProcessesrVrTosr:existspathsepjoinrS)r#rrr"rr&test_launchWorkerProcessess z/DistTrialRunnerTests.test_launchWorkerProcessescCslg}t|}||j|t}tdD]}|tq|j||| |j d| |j |jj dS)zm C{run} starts the reactor exactly once and spawns each of the workers exactly once. r2N) r- addCleanuprmrr}addTestrrerIrVrCr5 _workerNumber)r#r1 fakeReactorsuiterr"r"r&r^ s zDistTrialRunnerTests.test_runcsGfdddt}}t|tj|dtd}||j j _ g}||}j |t }tdD]}|tqCj ||dS)z L{DistTrialRunner} checks if the test directory is already locked, and if it is generates a name based on it. cseZdZfddZdS)zKDistTrialRunnerTests.test_runUsedDirectory..CountingReactorWithLockc s|j|tj|jtjtjdt|j t d} | |j d7_ | tdd|j_dS)Nz-1z-1.lockr2cWtdSr.r rQr"r"r&.szjDistTrialRunnerTests.test_runUsedDirectory..CountingReactorWithLock.spawnProcess..)r0r3rVrr:abspath _logDirectoryrstrr5rrRlockr4r _ampProtocolrI)oselfrlr8rH localLockr#rcr"r&r?"s    zXDistTrialRunnerTests.test_runUsedDirectory..CountingReactorWithLock.spawnProcessN)r(r)r*r?r"rr"r&CountingReactorWithLock!sr _trial_temp.lockrN)r-rdrmkdirr:rrrrunlockre_workingDirectoryrmrr}rrrI)r#r newDirectoryrr1rrrr"rr&test_runUsedDirectorys    z*DistTrialRunnerTests.test_runUsedDirectorycCsJg}t|}||j||jt|||jd||jddS)zh L{DistTrialRunner} doesn't try to start more workers than the number of tests. r2N) r-rrmrerIrrVrCr5)r#r1rr"r"r&test_minimalWorkerCs z'DistTrialRunnerTests.test_minimalWorkercCsPg}t|}||j|d|j_|jt|}||t||j t dS)z Running with the C{unclean-warnings} option makes L{DistTrialRunner} uses the L{UncleanWarningsReporterWrapper}. TN) r-rrmre_uncleanWarningsrIrrroriginalr)r#r1rrur"r"r&test_runUncleanWarningsPs z,DistTrialRunnerTests.test_runUncleanWarningscCsNt}t}|j||}||t|jj}|d||d|dS)z When the suite contains no test, L{DistTrialRunner} takes a shortcut path without launching any process or starting the reactor. Running 0 testPASSEDN) rxrrerIrrrfgetvalueassertIn)r#rrruoutputr"r"r&test_runWithoutTest^s   z(DistTrialRunnerTests.test_runWithoutTestcCs~t}tdttd}|j||}||t|jj }| d|| d|| d|| d|| d|dS)z Even if there is no test, the suite can contain an error (most likely, an import error): this should make the run fail, and the error should be printed. zan errorzfoo barrzerrors=1FAILEDN) rxrr RuntimeErrorrerIrrrfrr)r#rrrurr"r"r&!test_runWithoutTestButWithAnErrorks      z6DistTrialRunnerTests.test_runWithoutTestButWithAnErrorcCsGdddt}|\}}g}||}||j||jt||j}||j d||j d| |dt |j jdS)zw If for some reasons we can't connect to the worker process, the test suite catches and fails. c@eZdZddZddZdS)zMDistTrialRunnerTests.test_runUnexpectedError..CountingReactorWithFailc_4|j||t|jd7_|j|j_dSNr2)r0r3r4r r5 failingRunrrIr#rlr8rHr"r"r&r?  zZDistTrialRunnerTests.test_runUnexpectedError..CountingReactorWithFail.spawnProcesscSs ttdS)Noops)rrr#caserur"r"r&rs zXDistTrialRunnerTests.test_runUnexpectedError..CountingReactorWithFail.failingRunN)r(r)r*r?rr"r"r"r&CountingReactorWithFail rr2N)r-rqrrmrerIr cooperaterVrCr5pumpr\rfailures)r#rrnrpr1rrur"r"r&test_runUnexpectedError|s z,DistTrialRunnerTests.test_runUnexpectedErrorcsGdddt}jjg}||jtfdd}tjdgtjddg |t t d|S)zz L{DistTrialRunner} calls C{reactor.stop} and unlocks the test directory once the tests have run. c@r)zODistTrialRunnerTests.test_runStopAfterTests..CountingReactorWithSuccessc_rrr0r3r4r r5 succeedingRunrrIrr"r"r&r?rz\DistTrialRunnerTests.test_runStopAfterTests..CountingReactorWithSuccess.spawnProcesscSrr.rrr"r"r&rsz]DistTrialRunnerTests.test_runStopAfterTests..CountingReactorWithSuccess.succeedingRunNr(r)r*r?rr"r"r"r&CountingReactorWithSuccessrrc,td}|djdS)Nrr2rrTrrVrArrr#rcr"r&checks z:DistTrialRunnerTests.test_runStopAfterTests..checkbeforeshutdownr) r-rerrIrrVlisttriggerskeysrmrr)r#rr1rr"rr&test_runStopAfterTestss   z+DistTrialRunnerTests.test_runStopAfterTestscsg}jjt|jtfdd}fddtjdgtjddg |t ddjddD |S) z L{DistTrialRunner} waits for the worker processes to stop when the reactor is stopping, and then unlocks the test directory, not trying to stop the reactor again. cs ttdS)Nr)rr)ign) realCheckr"r&rs zEDistTrialRunnerTests.test_runWaitForProcessesDeferreds..checkcr)Nrrrrrr"r&rs zIDistTrialRunnerTests.test_runWaitForProcessesDeferreds..realCheckrrcSs(g|]\}}}t|g|Ri|qSr")r )ryrGakwr"r"r&r{szJDistTrialRunnerTests.test_runWaitForProcessesDeferreds..) rerr-rIrrVrrrrmr addCallback)r#r1rr")rrr#rcr&!test_runWaitForProcessesDeferredss    z6DistTrialRunnerTests.test_runWaitForProcessesDeferredscsgGfdddt}g}||}||j||\}}|jjt||jdd}|| dt | | |jj }|d||d|dS) z L{DistTrialRunner} can run in C{untilFailure} mode where it will run the given tests until they fail. cs eZdZddZfddZdS)zMDistTrialRunnerTests.test_runUntilFailure..CountingReactorWithSuccessc_rrrrr"r"r&r?rzZDistTrialRunnerTests.test_runUntilFailure..CountingReactorWithSuccess.spawnProcesscs*dtdkrttdStdS)Nr)r3r\rrr rcalledr"r&rs   z[DistTrialRunnerTests.test_runUntilFailure..CountingReactorWithSuccess.succeedingRunNrr"rr"r&rsrT)r untilFailurerrFAILN)r-rrmrqrerIrrrrVr\rR wasSuccessfulrfrr)r#rr1rrnrprurr"rr&test_runUntilFailures     z)DistTrialRunnerTests.test_runUntilFailureN)r(r)r*r+rKrmrqrvrrr^rrrrrrrrrr"r"r"r&ras$    (  " !ra)7r+rrSiorzope.interfacerrtwisted.internetrrrtwisted.internet.deferrr r r twisted.internet.mainr twisted.internet.protocolr rtwisted.internet.taskrrtwisted.python.failurertwisted.python.lockfilertwisted.test.proto_helpersrtwisted.test.test_cooperatorr twisted.trial._dist.distreporterrtwisted.trial._dist.disttrialrtwisted.trial._dist.workerrtwisted.trial.reporterrrrtwisted.trial.runnerrrtwisted.trial.unittestrrr rMr-rJr_rar"r"r"r&s4          :8