Находки в опенсорсе: Python

رفتن به کانال در Telegram

Легкие задачки в опенсорсе из мира Python Чат: @opensource_findings_chat

نمایش بیشتر

روسيا321 528 فناوری و برنامه‌ها41 306

969

مشترکین

اطلاعاتی وجود ندارد24 ساعت

-47 روز

-630 روز

636

نمایش های پست

~ 26024 ساعت

~ 28648 ساعت

65.50%

نرخ مشارکت

اطلاعاتی وجود ندارد

پست های در روز

Ads index

beta

آرشیو پست ها

970

🚀 New issue to wemake-services/django-modern-rest by @sobolevn 📝 Unskip `test_msgspec` files on 3.14 with new released version (#334) msgspec@0.20.0 is out and updated in #333. Now all tests in test_plugins/test_msgpspec can be executed on 3.14 as well. We need a PR with the fix that removes all pytest.skip directives for 3.14 from these files. #enhancement #good_first_issue #help_wanted #django_modern_rest sent via relator

970

В descanso необходимо сделать новый RequestTransformer, который бы генерировал хэдер для basic auth. https://github.com/reagento/descanso/issues/85

970

🚀 New issue to ag2ai/faststream by @nectarindev 📝 feat: merge `Broker(context=...)` and `FastStream(context=...)` at broker-level (#2693) I recently migrated my project to faststream 0.6. I was very interested in how I could add my dependencies to the context. Prior to version 0.6, I did something like this:

from faststream.annotations import ContextRepo
from faststream.kafka import KafkaBroker
from faststream.utils.context import context

broker = KafkaBroker()


@broker.subscriber("my_topic", group_id="my_group")
async def handle(
    context: ContextRepo,
):
    print("dependency: ", context.get("dependency"))  # 42


async def lifespan(*args, **kwargs):
    context.set_global("dependency", 42)

    await broker.start()
    try:
        yield
    finally:
        await broker.stop()

I launched the broker as part of my application in lifespan without using the FastStream class. For version 0.6, I saw examples where it was suggested to pass the context to FastStream, but that solution did not suit me. I discovered that the broker also accepts context, and that solves my problem:

broker = KafkaBroker(context=ContextRepo({"dependency": 42}))

...

async def lifespan(*args, **kwargs):
    await broker.start()
    try:
        yield
    finally:
        await broker.stop()

But I also discovered that if I create a FastStream instance, its context will be used, even though I didn't use it to start the broker.

from fastapi import FastAPI
from faststream import ContextRepo, FastStream
from faststream.kafka import KafkaBroker

broker = KafkaBroker(context=ContextRepo({"broker_dependency": 2}))
app = FastStream(broker, context=ContextRepo({"application_dependency": 1}))


@broker.subscriber("my_topic", group_id="my_group")
async def handle(
    context: ContextRepo,
):
    print("broker_dependency: ", context.get("broker_dependency"))            # None
    print("application_dependency: ", context.get("application_dependency"))  # 1


async def lifespan(*args, **kwargs):
    await broker.start()
    try:
        yield
    finally:
        await broker.stop()


asgi = FastAPI(lifespan=lifespan)

I'm not sure that's normal behavior. It would make much more sense if only the broker's dependency were available. ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Running FastStream 0.6.3 with CPython 3.12.4 on Linux #enhancement #good_first_issue #core #faststream #ag2ai sent via relator

970

from faststream.annotations import ContextRepo
from faststream.kafka import KafkaBroker
from faststream.utils.context import context

broker = KafkaBroker()


@broker.subscriber("my_topic", group_id="my_group")
async def handle(
    context: ContextRepo,
):
    print("dependency: ", context.get("dependency"))  # 42


async def lifespan(*args, **kwargs):
    context.set_global("dependency", 42)

    await broker.start()
    try:
        yield
    finally:
        await broker.stop()

broker = KafkaBroker(context=ContextRepo({"dependency": 42}))

...

async def lifespan(*args, **kwargs):
    await broker.start()
    try:
        yield
    finally:
        await broker.stop()

But I also discovered that if I create a FastStream instance, its context will be used, even though I didn't use it to start the broker.

from fastapi import FastAPI
from faststream import ContextRepo, FastStream
from faststream.kafka import KafkaBroker

broker = KafkaBroker(context=ContextRepo({"broker_dependency": 2}))
app = FastStream(broker, context=ContextRepo({"application_dependency": 1}))


@broker.subscriber("my_topic", group_id="my_group")
async def handle(
    context: ContextRepo,
):
    print("broker_dependency: ", context.get("broker_dependency"))            # None
    print("application_dependency: ", context.get("application_dependency"))  # 1


async def lifespan(*args, **kwargs):
    await broker.start()
    try:
        yield
    finally:
        await broker.stop()


asgi = FastAPI(lifespan=lifespan)

970

970

🚀 New issue to ag2ai/faststream by @gaby 📝 bug: Usage of custom logger results in no logs (#2677) Is your feature request related to a problem? Please describe. The built-logger is configured to always add colors, even when passing a logger to faststream. This is hardcoded here https://github.com/ag2ai/faststream/blob/main/faststream/_internal/logger/logging.py#L80 This affects systems collecting logs from faststream hosts. This makes loga generated by faststream to show in raw text as "\033[36mDEBUG\033[0m" instead of DEBUG. Describe the solution you'd like Make the use_colors param configurable instead of a hardcoded value. Describe alternatives you've considered Writing a custom log parser. #enhancement #good_first_issue #faststream #ag2ai sent via relator

970

🚀 New issue to ag2ai/faststream by @GrigoriyKuzevanov 📝 Bug: min_idle_time ignored when group and consumer are specified (#2678) Describe the bug When a StreamSub has both 'group' and 'consumer', and 'min_idle_time' specified, Faststream uses 'XREADGROUP' instead of 'XAUTOCALIM' How to reproduce Include source code:

from faststream import FastStream
from faststream.redis import RedisBroker, StreamSub

broker = RedisBroker("redis://localhost:6379")

@broker.subscriber(
    stream=StreamSub(
        "orders",
        group="processors",
        consumer="claimer",
        min_idle_time=10000,  # Should trigger XAUTOCLAIM
    )
)
async def claiming_handler(msg):
    print("Should use XAUTOCLAIM, but uses XREADGROUP")


app = FastStream(broker)

Redis MONITOR output shows:

XREADGROUP GROUP processors claimer BLOCK 100 STREAMS orders >

Expected behavior

XAUTOCLAIM orders processors claimer 10000 0-0 COUNT 1

Observed behavior I suppose that a root cause in faststream/redis/subscriber/use_cases/stream_subscriber, method _StreamHandlerMixin.start():

if stream.group and stream.consumer:  # ← Checked FIRST
    # Uses XREADGROUP
    ...
elif self.stream_sub.min_idle_time is None:
    # Uses XREAD
    ...
else:
    # Uses XAUTOCLAIM ← Never reached when group is set!
    ...

Or i just misunderstand the logic. Environment Running FastStream 0.6.3 with CPython 3.12.3 on Linux #bug #good_first_issue #faststream #ag2ai sent via relator

970

Upgrade Python versions https://github.com/pomponchik/instld/issues/21 #good_first_issue #github_actions #super_simple

970

Support sync and async transport using HTTPX in addition to aiohttp and requests: https://github.com/reagento/descanso/issues/47 #descanso

970

🚀 New issue to ag2ai/faststream by @Sehat1137 📝 Skip relator notification from the dependabot (#2665) Improve pipeline so that it is not triggered by events from dependabot. https://github.com/ag2ai/faststream/blob/main/.github/workflows/relator.yaml#L19 #good_first_issue #github_actions #faststream #ag2ai sent via relator

970

🚀 New issue to ag2ai/faststream by @jsonvot 📝 Bug: The coexistence issue between URL and virtualhost (#2652) Describe the bug

import asyncio
from faststream.rabbit import RabbitBroker

async def pub():
    broker = RabbitBroker('amqp://guest:guest@localhost:5672/', virtualhost='/domestic-aed')  # 1
 
 #broker = RabbitBroker('amqp://guest:guest@localhost:5672', virtualhost='//domestic-aed') # 2
 #broker = RabbitBroker('amqp://guest:guest@localhost:5672/', virtualhost='//domestic-aed') # 3
 #broker = RabbitBroker('amqp://guest:guest@localhost:5672//domestic-aed') # 4
 
 #broker = RabbitBroker('amqp://guest:guest@localhost:5672', virtualhost='/domestic-aed') # 5
    async with broker:
        await broker.publish(
            "Hi!",
            queue="test-queue",
            exchange="test-exchange"
        )
asyncio.run(pub())

In version v0.5.33, the first method works properly, and the trailing slash (/) at the end of the URL cannot be omitted. However, in versions >=0.5.34, due to additional handling of virtualhost, only parameter-based formats like 2, 3, 4 and 5 are supported. I believe method 5 is the most intuitive and should be handled correctly, but it is currently treated as an invalid format. Using this method will result in the following error: 🖼️Image Environment faststream[rabbit]>=0.5.34 #bug #good_first_issue #faststream #ag2ai sent via relator

970

🚀 New issue to wemake-services/django-modern-rest by @sobolevn 📝 Test that we support new styled type aliases as request / return types (#275) We have a special test case for different types that we support https://github.com/wemake-services/django-modern-rest/blob/998715103c375edf4270cbf89cb68d5fad10365e/tests/testunit/testvalidation/testtypevalidation.py#L48-L64 This test is missing a case like

type MyInt = int

Please, add it :) Note, that type X is 3.12+ syntax, while we also support 3.11 So, this needs to be added with a guard and probably exec('type MyInt = int') #goodfirstissue #enhancement #help_wanted sent via relator

970

🚀 New issue to wemake-services/django-modern-rest by @sobolevn 📝 Validate that cookies= definition is correct (#273) We now support #234 cookies and their definition with NewCookie and CookieSpec. But, we don't have a validation / test for their correct usage, like we do for NewHeader / HeaderSpec. Let's do it! See validation: https://github.com/wemake-services/django-modern-rest/blob/998715103c375edf4270cbf89cb68d5fad10365e/djangomodernrest/validation/endpoint_metadata.py#L90-L104 https://github.com/wemake-services/django-modern-rest/blob/998715103c375edf4270cbf89cb68d5fad10365e/djangomodernrest/validation/endpoint_metadata.py#L443-L458 And test: https://github.com/wemake-services/django-modern-rest/blob/998715103c375edf4270cbf89cb68d5fad10365e/tests/testunit/testendpoint/testmodifydecorator.py#L58-L69 This is a nice DX improvement. #helpwanted #enhancement #goodfirst_issue sent via relator

970

New issue to wemake-services/django-modern-rest by @sobolevn Validate that we can't set `Set-Cookie` header and should use `cookies=` instead (#259) When using @validate and @modify we must check that no ResponseSpec.headers contain Set-Cookie header description / modification. If so, we need to raise an error that cookies= parameter must be used instead. #django_modern_rest #help_wanted #enhancement #good_first_issue sent via relator

970

Никто не хочет законтрибутить в Pydantic? Нужно добавить им в CI third-party прогон тестов для FastDepends https://github.com/pydantic/pydantic/issues/12410 Вот в эту джобу, если что

970

🚀 New issue to wemake-services/wemake-python-styleguide by @sobolevn 📝 Allow / in WPS226 (#3554) String like '/' must not raise string overuse violation, because / is very common in url buildings / path building. We need to add it to https://github.com/wemake-services/wemake-python-styleguide/blob/7f4f7ae24309149aa03d36846a96fb4410b8022e/wemakepythonstyleguide/visitors/ast/complexity/overuses.py#L37 #feature #goodfirstissue #levelstarter #help_wanted sent via relator

970

🚀 New issue to wemake-services/django-modern-rest by @sobolevn 📝 Optimize _is_validation_enabled by using cache (#230) This method is in hot-path, it is called for every response: https://github.com/wemake-services/django-modern-rest/blob/c6071d9907c72a54258bc7f644822e91640559d4/djangomodernrest/validation.py#L137-L162 So, we need to optimize it to the max. I propose to: 1. Make a function out of this method 2. Use @lru_cache(maxsize=MAX_CACHE_SIZE) as we do in other places to cache the function result (since the result can't change for a given endpoint / controller) 3. Profit! #enhancement #goodfirstissue #help_wanted sent via relator

970

🚀 New issue to wemake-services/django-modern-rest by @sobolevn 📝 Change how ResponseValidator is selected (#229) There's a room for potential optimization of how ResponseValidator is selected. How it works now: https://github.com/wemake-services/django-modern-rest/blob/c6071d9907c72a54258bc7f644822e91640559d4/djangomodernrest/endpoint.py#L304-L323 We can remove this if isinstance from the hot path to the import time. We would need to select proper ResponseValidator type for the response during metadata build in endpoint.py https://github.com/wemake-services/django-modern-rest/blob/c6071d9907c72a54258bc7f644822e91640559d4/djangomodernrest/endpoint.py#L97-L109 We would need to types: • one for validating HttpResponses • one for raw responses #enhancement #helpwanted #goodfirst_issue sent via relator

970

New issue to wemake-services/django-modern-rest by @sobolevn Validate that controllers with `blueprints` can't have `component_parsers` (#217) Otherwise we would do two parsings in a single HTTP request. This is not good. Right now this code is possible:

@final
class _ErrorBody(pydantic.BaseModel):
    error: int

class _ErrorHandlingBlueprint(
    Blueprint[PydanticSerializer], 
    Body[_ErrorBody],  # <- first body parsing
):
    def post(self) -> str:
        return str(self.parsed_body.error)

class _ErrorHandlingController(
    Controller[PydanticSerializer], 
    Body[dict[str, int]],  # <- second body parsing
):
    blueprints: ClassVar[Sequence[_BlueprintT]] = [_ErrorHandlingBlueprint]

    def get(self) -> int:
         return self.parsed_body.get('error', 0)

This must raise a validation exception in ControllerValidator. We allow endpoints in the final composed controllers, but they must not use any parsing. Like OPTIONS, for example. If users want to have parsed data, then they should create a blueprint. #django_modern_rest #good_first_issue #enhancement #help_wanted sent via relator

970

https://github.com/python/cpython/issues/140764 #cpython #easy