[BEAM-3141][WIP] Support the coders in Python 3#4078

Closed

holdenk wants to merge 27 commits into

apache:masterfrom

holdenk:BEAM-3141-coder-py3-support-r2

Commits on Feb 15, 2018

Fix unicode imports and NoneType
holdenk
committed
Swap the avroio over to BytesIO
holdenk
committed
Swithc apiclinet to io StringIO from StringIO StringIO
holdenk
committed
Switch required packages based on Python version (currently only impacting avro) and add future geq 0.16.0
holdenk
committed
Rewrite lambda with expansion
holdenk
committed
Fix items and builtin import and a long import
holdenk
committed
Switch filesystem to io.StringIO
holdenk
committed
Fix cirular dep introduced through Py3 import changes for CreatePTransformOverride.
holdenk
committed
Change slow_stream to bytes
holdenk
committed
Handle slow_stream in py2 again
holdenk
committed
Selective fixes while running through apache_beam.examples.complete.game.game_stats_test.GameStatsTest, fix some rethrows. lambda expansion, imports, and metaclass
holdenk
committed
metaclass rewrite rule
holdenk
committed
Add __hash__ methods in places where needed (in progress)
holdenk
committed
Provide a base ne using eq for windows
holdenk
committed
Provide eq/hashing/sorting for TimestampedValue
holdenk
committed
Rich comparisions requirement
holdenk
committed
If we are passed in bytes for the lookup in pipeline_context do the lookup as a string
holdenk
committed
queue and raise rewrites
holdenk
committed
futurize -wn -f libfuturize.fixes.fix_future_standard_library_urllib ./apache_beam
holdenk
committed
Finish up getting apache_beam.examples.complete.game.game_stats_test.GameStatsTest to run, fix serialized values map over, switch some exception re-throws, iteritems, and handle peaking at the eval…
holdenk
committed
Fix the write_byte on slow stream to just use bytes rather than encode
holdenk
committed
Fix some bytes coders tests to use bytes in py3
holdenk
committed
Change the fall through for encoding a bit and update past imports
holdenk
committed
Only wrap in bytes for py3
holdenk
committed
Fix remaining coder issues accross py2/3
holdenk
committed
Style fixes, remove uneeded imports after other unrelated things fixed upstream.
holdenk
committed
Fix instance check
holdenk
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[BEAM-3141][WIP] Support the coders in Python 3#4078

[BEAM-3141][WIP] Support the coders in Python 3#4078
holdenk wants to merge 27 commits into
apache:masterfrom
holdenk:BEAM-3141-coder-py3-support-r2

Commits on Feb 15, 2018

Fix unicode imports and NoneType

Swap the avroio over to BytesIO

Swithc apiclinet to io StringIO from StringIO StringIO

Switch required packages based on Python version (currently only impacting avro) and add future geq 0.16.0

Rewrite lambda with expansion

Fix items and builtin import and a long import

Switch filesystem to io.StringIO

Fix cirular dep introduced through Py3 import changes for CreatePTransformOverride.

Change slow_stream to bytes

Handle slow_stream in py2 again

Selective fixes while running through apache_beam.examples.complete.game.game_stats_test.GameStatsTest, fix some rethrows. lambda expansion, imports, and metaclass

metaclass rewrite rule

Add hash methods in places where needed (in progress)

Provide a base ne using eq for windows

Provide eq/hashing/sorting for TimestampedValue

Rich comparisions requirement

If we are passed in bytes for the lookup in pipeline_context do the lookup as a string

queue and raise rewrites

futurize -wn -f libfuturize.fixes.fix_future_standard_library_urllib ./apache_beam

Finish up getting apache_beam.examples.complete.game.game_stats_test.GameStatsTest to run, fix serialized values map over, switch some exception re-throws, iteritems, and handle peaking at the eval…

Fix the write_byte on slow stream to just use bytes rather than encode

Fix some bytes coders tests to use bytes in py3

Change the fall through for encoding a bit and update past imports

Only wrap in bytes for py3

Fix remaining coder issues accross py2/3

Style fixes, remove uneeded imports after other unrelated things fixed upstream.

Fix instance check