8000 HadoopFilesystem.mkdir() should use -p · Issue #991 · Yelp/mrjob · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
HadoopFilesystem.mkdir() should use -p #991
Closed
@coyotemarin

Description

@coyotemarin

#845 patched HadoopRunner._mkdir_on_hdfs() to use -p on Hadoop 2.0+, but we didn't patch HadoopFilesystem.mkdir(), so it's probably still broken on newer versions of Hadoop.

Honestly, I'm not entirely sure why _mkdir_on_hdfs() exists; we should just be using self.fs.mkdir().

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0