doctr with lots of files in docs

[thequackdaddy]

So we sucessfully set up doctr to generate the documentation for statsmodels. Cool tool, I like it.

However, statsmodels generates lots, and lots, and lots of files for itss docs.

It looks like doctr is taking about 20 minutes to cycle through the git add file here:

doctr/doctr/travis.py

Lines 477 to 482 in 5067c1e

	DOCTR_COMMAND = ' '.join(map(shlex.quote, sys.argv))
	for f in added:
	run(['git', 'add', f])
	for f in removed:
	run(['git', 'rm', f])

Any ideas how to speed this up?

[thequackdaddy]

Here's an example merge commit... it finishes with only a few minutes before the 50 minute travis limit...

https://travis-ci.org/statsmodels/statsmodels/builds/430288369

[asmeurer]

Maybe we can run one giant git add instead. We could also probably use some other git commands to detect which files are changed or untracked and only add those.

[bashtage]

@asmeurer Do you have any plans for a release in the near future? statsmodels is very close on Travis to the limit (typically ~46 minutes) and it would be good to get the git add improvements in.

If you aren't going to release we could clone git -- but a release is preferred.

[gforsyth]

I can cut a new release this evening (ET) if @asmeurer doesn't get to it before then.

[asmeurer]

I was going to do it. I want to take a look at the other PRs first. We probably should hold off on the travis-ci.com stuff, but the others can likely go in.

[asmeurer]

Actually just #320 is probably ready to go.

[bashtage]

Thanks both.

[asmeurer]

1.7.4 release is out on PyPI now and will be on conda-forge later. https://drdoctr.github.io/changelog.html