Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • B buck
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 201
    • Issues 201
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 22
    • Merge requests 22
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Meta
  • buck
  • Issues
  • #155
Closed
Open
Issue created Jul 14, 2014 by Administrator@rootContributor

Problem with normpath_join in buck.py makes 'parsing build files' very slow

Created by: mread

strace shows that almost all the "parsing build files" time is spent making calls to lstat with invalid paths. These paths are constructed by the normpath_join function as part of glob_walk.

The function concatenates normpath and element but sometimes these overlap, e.g. picking some output at random from buck test --all and dumping normpath and element to stderr:

normpath = '/mnt/scratch/readm/work/git-checkouts/buck/third-party/java/aosp/tests/tests/src/tests/src/com/tests/src/com/android/tests/src/com/android/manifmerger/tests/src/com/android/manifmerger/data'
element = 'tests/src/com/android/manifmerger/data/47_uses_feat_gles_conflict.xml'

Concatenating these and calling os.path.islink is pointless and with a working directory containing approximately 78k source files has a huge performance penalty.

Assignee
Assign to
Time tracking