Skip to content

Enqueue Utils

This page documents enqueue functions in the GTFS module.

ingestor.chalicelib.gtfs.enqueue

enqueue_feed_keys_to_sqs(feed_keys, force_rebuild_feeds=False)

Send GTFS feed keys to an SQS queue for asynchronous ingestion.

Parameters:

Name Type Description Default
feed_keys List[str]

List of GTFS feed key strings to enqueue.

 required
force_rebuild_feeds bool

If True, forces feeds to be rebuilt even if they already exist. Defaults to False.

 False
Source code in ingestor/chalicelib/gtfs/enqueue.py 
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
def enqueue_feed_keys_to_sqs(feed_keys: List[str], force_rebuild_feeds: bool = False) -> None:
    """Send GTFS feed keys to an SQS queue for asynchronous ingestion.

    Args:
        feed_keys: List of GTFS feed key strings to enqueue.
        force_rebuild_feeds: If True, forces feeds to be rebuilt even if they
            already exist. Defaults to False.
    """
    sqs = boto3.resource("sqs")
    queue = sqs.get_queue_by_name(QueueName="gtfs-ingest-keys")
    for feed_key in feed_keys:
        queue.send_message(
            MessageBody=json.dumps(
                {
                    "feed_key": feed_key,
                    "force_rebuild_feeds": force_rebuild_feeds,
                }
            )
        )