8000 add type annotations and rework some None/unset/default cases by pajod · Pull Request #3201 · benoitc/gunicorn · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

add type annotations and rework some None/unset/default cases #3201

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 10 commits into from

Conversation

pajod
Copy link
Contributor
@pajod pajod commented May 5, 2024

Apparently we can ship type annotations in separate *.pyi files right now, with no need to await dropping 3.7 compat and no obvious harm to people that have no use for them. Reworking #2377 I ended up with a certainly still imperfect, but already somewhat useful set of annotations. A few default settings in gunicorn popped out as odd:

  • setting --config="" does not disable reading configuration. the next best thing, setting --config=/dev/null loudly complains
  • enabling --reload has non-obvious side-effects in error handling, and setting --reload-extra= is silently ignored when set in isolation
  • settings that take a callable put the staticmethod in the next line instead of as a decorator. this way static checkers cannot tell the default callables are never meant to receive the usual self method arg.
    • refactoring this requires a minor fix in docs/gunicorn_ext.py to keep documentation unaffected
  • uid/gid settings default to trying even when not expecting any changes.. is this needed? the only effect appears to be breaking some WSL corner cases (where thats not a no-op but a hard error)
  • gid = abs(gid) & 0x7FFFFFFF <= now unnecessary and broken for systems that actually use group id > 2**32 (see gunicorn/util.py set_owner_process Mangling gid on RHEL8 + Google Cloud Platform (very large int group id) #3212)
  • setting --gid=number without setting --uid=number is.. surprising. There is still that root group in the supplementary group list. Looks like Debian did not like this and patched it - though I would probably branch the initgroups case.
  • pytest-cov does not mix well with running just coverage run -m pytest (telling me no coverage was collected..) - is it even needed for anything other than invocation brevity, which is already dealt with by inclusion in tox & Makefile?
  • There is a str/bytes type confusion in the gevent_pywsgi worker class (but this was already noticed independently, see Access log formatting is wrong when using gevent_pywsgi worker class #2940)

This is primarily an invitation to discuss potential default settings changes, the attached patches serve as clarification.

Advantages of shipping type annotations:

  • highlight oddities in current behaviour stemming from ambiguous/overloaded methods
  • can be checked in CI: automatically receive notification before introducing potential type confusion bugs
  • assists in understanding existing code, even where currently little to no documentation exists
  • assists in reviewing changes which incorporate type changes, easing complex rebase work of outstanding PRs
  • helpful in extracting a list of items to be touch when planning to reclassify previously public/unspecified API into private
  • enhances IDE features such as quickly navigating to definitions of types or method arguments

Disadvantages of shipping type annotations:

  • people submitting new PRs without updating annotations may see less self-explanatory feedback from CI runners
  • as long as any annotation is incorrect or incompatible with a popular tool such as mypy, expect some people to show up and report those bugs in annotations at a time where there already are quite a lot open bugs/PRs

Related

Fixes: #2833 #2374 #1393

raise ValueError("Invalid header map behaviour: %s" % val)


class OnFatal(Setting):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Naming pattern clash. Sounds like Server Hook but is not implemented as such.

@benoitc benoitc self-assigned this Jun 14, 2024
@benoitc
Copy link
Owner
benoitc commented Aug 10, 2024

Thanks for the patch. However I don't think having type annotation external to the project will be convenient on the long term. This introduces too much constraints as you mention.

Also do we really need to introduce type annotation? What would be the addition there for the project? I think the synttax makes the code barely readable and only adapted for those runing an IDE or vscode. Also I don't want to go to the path we have to set specific rules or properties to ignore some results during type checking. IMO we would better invest in adding property base checking or equivalent there.

@Dreamsorcerer
Copy link
Dreamsorcerer commented Feb 3, 2025

only adapted for those runing an IDE

It would make it easier to maintain projects that depend on this library (I personally don't use an IDE, but we use mypy for very strict type checking throughout all our projects). For example, we don't have anyone on aiohttp at the moment that is familiar with the gunicorn worker, so more type information that can be verified with a type checker would make it easier for us to maintain.

I'd also argue that those annotations may actually improve readability. Looking at the diff, most annotations are single word types. Including them means that I can see what types are being used at a glance, whereas right now I'd have to dig through the code to figure that out, or just guess.

@pajod
Copy link
Contributor Author
pajod commented Feb 4, 2025

I think the synttax makes the code barely readable

Hence the suggestion of shipping separate .pyi files - for those who care, to be ignored otherwise - instead of placing the annotations inline.

the path we have to set specific rules or properties to ignore some results during type checking

No need to, mypy is perfectly happy to work with _typeshed.Incomplete annotations for cases where we do not (yet) wish to bother adding a fully compliant type.

only adapted for those runing an IDE or vscode

I have been using a version of these for a year now, without any IDE in the loop - purely for CI reasons.


I can split out the default settings changes so you can merge the *.py and the *.pyi+CI changes separately, and/or rebase as-is (possibly on top of #3272, for more readable code), whatever you prefer.

Edit: Split and resubmitted as #3360

@benoitc
Copy link
Owner
benoitc commented Mar 7, 2025

this PR is mixing topic. PLease remove the type hint related change as ai'm not interrested to includes it in gunicorn. The rest looks ok.

@benoitc
Copy link
Owner
benoitc commented Mar 27, 2025

let's close this PR and continue discussion on functional changes , which is what really matter.

@benoitc benoitc closed this Mar 27, 2025
@sth
Copy link
sth commented Mar 30, 2025

It would make sense to crate an independent types-gunicorn package and move the *.pyi files there. Then the main gunicorn can remain unchanged and untyped, but users of the library can still choose to get type checking of the interface by additionally installing the types-gunicorn package.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add support for PEP 484 Type Hints
4 participants
0