The server does not start

Administrators
1

I have installed everything according to the documentation several times, but in spite of that I always get errors with indico-celery. I am new to all this, but really want to figure it out :slight_smile:
Here’s log:

2023-06-26 12:25:00,273  WARNING  0000000000000000  -       celery.redirected         --- Logging error ---
2023-06-26 12:25:00,274  WARNING  0000000000000000  -       celery.redirected         Traceback (most recent call last):
2023-06-26 12:25:00,274  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected         psycopg2.errors.UndefinedTable: relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected         
The above exception was the direct cause of the following exception:
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected         Traceback (most recent call last):
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task
    R = retval = fun(*args, **kwargs)
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 231, in _inner
    reraise(*exc_info)
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 60, in reraise
    raise value
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 226, in _inner
    return f(*args, **kwargs)
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/core.py", line 138, in __call__
    rv = super().__call__(*args, **kwargs)
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__
    return self.run(*args, **kwargs)
2023-06-26 12:25:00,275  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/util.py", line 31, in wrapper
    return f(*args, **kwargs)
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/modules/events/reminders/tasks.py", line 20, in send_event_reminders
    reminders = (EventReminder.query
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2773, in all
    return self._iter().all()
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2916, in _iter
    result = self.session.execute(
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1717, in execute
    result = conn._execute_20(statement, params or {}, execution_options)
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1710, in _execute_20
    return meth(self, args_10style, kwargs_10style, execution_options)
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection
    return connection._execute_clauseelement(
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1577, in _execute_clauseelement
    ret = self._execute_context(
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1948, in _execute_context
    self._handle_dbapi_exception(
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2129, in _handle_dbapi_exception
    util.raise_(
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
2023-06-26 12:25:00,276  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected         sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^

[SQL: SELECT events.reminders.id AS events_reminders_id, events.reminders.event_id AS events_reminders_event_id, events.reminders.creator_id AS events_reminders_creator_id, events.reminders.created_dt AS events_reminders_created_dt, events.reminders.scheduled_dt AS events_reminders_scheduled_dt, events.reminders.is_sent AS events_reminders_is_sent, events.reminders.event_start_delta AS events_reminders_event_start_delta, events.reminders.recipients AS events_reminders_recipients, events.reminders.send_to_participants AS events_reminders_send_to_participants, events.reminders.send_to_speakers AS events_reminders_send_to_speakers, events.reminders.include_summary AS events_reminders_include_summary, events.reminders.include_description AS events_reminders_include_description, events.reminders.attach_ical AS events_reminders_attach_ical, events.reminders.reply_to_address AS events_reminders_reply_to_address, events.reminders.message AS events_reminders_message 
FROM events.reminders JOIN events.events ON events.events.id = events.reminders.event_id 
WHERE NOT events.reminders.is_sent AND NOT events.events.is_deleted AND events.reminders.scheduled_dt <= %(scheduled_dt_1)s]
[parameters: {'scheduled_dt_1': datetime.datetime(2023, 6, 26, 9, 25, 0, 99692)}]
(Background on this error at: https://sqlalche.me/e/14/f405)
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected         
During handling of the above exception, another exception occurred:
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected         Traceback (most recent call last):
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/handlers.py", line 1065, in emit
    smtp.send_message(msg)
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/smtplib.py", line 986, in send_message
    return self.sendmail(from_addr, to_addrs, flatmsg, mail_options,
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/smtplib.py", line 887, in sendmail
    raise SMTPSenderRefused(code, resp, from_addr)
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected         smtplib.SMTPSenderRefused: (530, b'5.7.1 Authentication required', 'logger@111')
2023-06-26 12:25:00,277  WARNING  0000000000000000  -       celery.redirected         Call stack:
2023-06-26 12:25:00,280  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/bin/indico", line 8, in <module>
    sys.exit(cli())
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/flask/cli.py", line 357, in decorator
    return __ctx.invoke(f, *args, **kwargs)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
2023-06-26 12:25:00,281  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/cli/core.py", line 105, in celery
    celery_cmd(ctx.args)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bin/base.py", line 134, in caller
    return f(ctx, *args, **kwargs)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bin/worker.py", line 351, in worker
    worker.start()
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/worker/worker.py", line 203, in start
    self.blueprint.start(self)
2023-06-26 12:25:00,282  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bootsteps.py", line 116, in start
    step.start(parent)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bootsteps.py", line 365, in start
    return self.obj.start()
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/base.py", line 129, in start
    self.on_start()
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/prefork.py", line 109, in on_start
    P = self._pool = Pool(processes=self.limit,
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/asynpool.py", line 463, in __init__
    super().__init__(processes, *args, **kwargs)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 1046, in __init__
    self._create_worker_process(i)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/asynpool.py", line 480, in _create_worker_process
    return super()._create_worker_process(i)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 1158, in _create_worker_process
    w.start()
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/process.py", line 124, in start
    self._popen = self._Popen(self)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/context.py", line 333, in _Popen
    return Popen(process_obj)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/popen_fork.py", line 24, in __init__
    self._launch(process_obj)
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/popen_fork.py", line 79, in _launch
    code = process_obj._bootstrap()
2023-06-26 12:25:00,283  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/process.py", line 327, in _bootstrap
    self.run()
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 292, in __call__
    sys.exit(self.workloop(pid=pid))
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 313, in sentry_workloop
    return old_workloop(*args, **kwargs)
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 362, in workloop
    result = (True, prepare_result(fun(*args, **kwargs)))
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 649, in fast_trace_task
    R, I, T, Rstr = tasks[task].__trace__(
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 208, in _inner
    return f(*args, **kwargs)
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 468, in trace_task
    I, R, state, retval = on_error(task_request, exc, uuid)
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 379, in on_error
    R = I.handle_error_state(
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 178, in handle_error_state
    return {
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 237, in handle_failure
    self._log_error(task, req, einfo)
2023-06-26 12:25:00,284  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 265, in _log_error
    logger.log(policy.severity, policy.format.strip(), context,
2023-06-26 12:25:00,285  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/__init__.py", line 1512, in log
    self._log(level, msg, args, **kwargs)
2023-06-26 12:25:00,285  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/__init__.py", line 1589, in _log
    self.handle(record)
2023-06-26 12:25:00,285  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/__init__.py", line 1599, in handle
    self.callHandlers(record)
2023-06-26 12:25:00,285  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/logging.py", line 96, in sentry_patched_callhandlers
    return old_callhandlers(self, record)
2023-06-26 12:25:00,285  WARNING  0000000000000000  -       celery.redirected         Message: 'Task %(name)s[%(id)s] %(description)s: %(exc)s'
Arguments: {'hostname': 'celery@111', 'id': '1c3ef194-4c4a-433d-b432-131cc1335912', 'name': 'event_reminders', 'exc': 'ProgrammingError(\'(psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist\\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\\n             ^\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context\n    self.dialect.do_execute(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute\n    cursor.execute(statement, parameters)\npsycopg2.errors.UndefinedTable: relation "events.reminders" does not exist\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\n             ^\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 231, in _inner\n    reraise(*exc_info)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 60, in reraise\n    raise value\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 226, in _inner\n    return f(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/core.py", line 138, in __call__\n    rv = super().__call__(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/util.py", line 31, in wrapper\n    return f(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/modules/events/reminders/tasks.py", line 20, in send_event_reminders\n    reminders = (EventReminder.query\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2773, in all\n    return self._iter().all()\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2916, in _iter\n    result = self.session.execute(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1717, in execute\n    result = conn._execute_20(statement, params or {}, execution_options)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1710, in _execute_20\n    return meth(self, args_10style, kwargs_10style, execution_options)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection\n    return connection._execute_clauseelement(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1577, in _execute_clauseelement\n    ret = self._execute_context(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1948, in _execute_context\n    self._handle_dbapi_exception(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2129, in _handle_dbapi_exception\n    util.raise_(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_\n    raise exception\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context\n    self.dialect.do_execute(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute\n    cursor.execute(statement, parameters)\nsqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\n             ^\n\n[SQL: SELECT events.reminders.id AS events_reminders_id, events.reminders.event_id AS events_reminders_event_id, events.reminders.creator_id AS events_reminders_creator_id, events.reminders.created_dt AS events_reminders_created_dt, events.reminders.scheduled_dt AS events_reminders_scheduled_dt, events.reminders.is_sent AS events_reminders_is_sent, events.reminders.event_start_delta AS events_reminders_event_start_delta, events.reminders.recipients AS events_reminders_recipients, events.reminders.send_to_participants AS events_reminders_send_to_participants, events.reminders.send_to_speakers AS events_reminders_send_to_speakers, events.reminders.include_summary AS events_reminders_include_summary, events.reminders.include_description AS events_reminders_include_description, events.reminders.attach_ical AS events_reminders_attach_ical, events.reminders.reply_to_address AS events_reminders_reply_to_address, events.reminders.message AS events_reminders_message \nFROM events.reminders JOIN events.events ON events.events.id = events.reminders.event_id \nWHERE NOT events.reminders.is_sent AND NOT events.events.is_deleted AND events.reminders.scheduled_dt <= %(scheduled_dt_1)s]\n[parameters: {\'scheduled_dt_1\': datetime.datetime(2023, 6, 26, 9, 25, 0, 99692)}]\n(Background on this error at: https://sqlalche.me/e/14/f405)\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False}
2023-06-26 12:25:00,141  ERROR    0000000000000000  -       celery.app.trace          Task event_reminders[1c3ef194-4c4a-433d-b432-131cc1335912] raised unexpected: ProgrammingError('(psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\n             ^\n')
Traceback (most recent call last):
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
psycopg2.errors.UndefinedTable: relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 231, in _inner
    reraise(*exc_info)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 60, in reraise
    raise value
  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 226, in _inner
    return f(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/core.py", line 138, in __call__
    rv = super().__call__(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__
    return self.run(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/util.py", line 31, in wrapper
    return f(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/modules/events/reminders/tasks.py", line 20, in send_event_reminders
    reminders = (EventReminder.query
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2773, in all
    return self._iter().all()
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2916, in _iter
    result = self.session.execute(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1717, in execute
    result = conn._execute_20(statement, params or {}, execution_options)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1710, in _execute_20
    return meth(self, args_10style, kwargs_10style, execution_options)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection
    return connection._execute_clauseelement(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1577, in _execute_clauseelement
    ret = self._execute_context(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1948, in _execute_context
    self._handle_dbapi_exception(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2129, in _handle_dbapi_exception
    util.raise_(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^

[SQL: SELECT events.reminders.id AS events_reminders_id, events.reminders.event_id AS events_reminders_event_id, events.reminders.creator_id AS events_reminders_creator_id, events.reminders.created_dt AS events_reminders_created_dt, events.reminders.scheduled_dt AS events_reminders_scheduled_dt, events.reminders.is_sent AS events_reminders_is_sent, events.reminders.event_start_delta AS events_reminders_event_start_delta, events.reminders.recipients AS events_reminders_recipients, events.reminders.send_to_participants AS events_reminders_send_to_participants, events.reminders.send_to_speakers AS events_reminders_send_to_speakers, events.reminders.include_summary AS events_reminders_include_summary, events.reminders.include_description AS events_reminders_include_description, events.reminders.attach_ical AS events_reminders_attach_ical, events.reminders.reply_to_address AS events_reminders_reply_to_address, events.reminders.message AS events_reminders_message 
FROM events.reminders JOIN events.events ON events.events.id = events.reminders.event_id 
WHERE NOT events.reminders.is_sent AND NOT events.events.is_deleted AND events.reminders.scheduled_dt <= %(scheduled_dt_1)s]
[parameters: {'scheduled_dt_1': datetime.datetime(2023, 6, 26, 9, 25, 0, 99692)}]
(Background on this error at: https://sqlalche.me/e/14/f405)
2

Does indico itself work? Or do you get errors there as well? Because this looks like the tables have not been created, e.g. because you forgot to run indico db prepare.

3

Thank you for such a quick answer :slight_smile:
Yes, i did run indico db prepare but i’ve get that error.
RN i’ve restarted ubuntu → indico db prepare → systemctl enable nginx.service postgresql.service redis-server.service indico-celery.service indico-uwsgi.service. But still getting errors:

2023-06-26 12:50:00,249  WARNING  0000000000000000  -       celery.redirected         --- Logging error ---
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected         Traceback (most recent call last):
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected         psycopg2.errors.UndefinedTable: relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected         
The above exception was the direct cause of the following exception:
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected         Traceback (most recent call last):
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task
    R = retval = fun(*args, **kwargs)
2023-06-26 12:50:00,250  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 231, in _inner
    reraise(*exc_info)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 60, in reraise
    raise value
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 226, in _inner
    return f(*args, **kwargs)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/core.py", line 138, in __call__
    rv = super().__call__(*args, **kwargs)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__
    return self.run(*args, **kwargs)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/util.py", line 31, in wrapper
    return f(*args, **kwargs)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/modules/events/reminders/tasks.py", line 20, in send_event_reminders
    reminders = (EventReminder.query
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2773, in all
    return self._iter().all()
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2916, in _iter
    result = self.session.execute(
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1717, in execute
    result = conn._execute_20(statement, params or {}, execution_options)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1710, in _execute_20
    return meth(self, args_10style, kwargs_10style, execution_options)
2023-06-26 12:50:00,251  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection
    return connection._execute_clauseelement(
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1577, in _execute_clauseelement
    ret = self._execute_context(
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1948, in _execute_context
    self._handle_dbapi_exception(
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2129, in _handle_dbapi_exception
    util.raise_(
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected         sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^

[SQL: SELECT events.reminders.id AS events_reminders_id, events.reminders.event_id AS events_reminders_event_id, events.reminders.creator_id AS events_reminders_creator_id, events.reminders.created_dt AS events_reminders_created_dt, events.reminders.scheduled_dt AS events_reminders_scheduled_dt, events.reminders.is_sent AS events_reminders_is_sent, events.reminders.event_start_delta AS events_reminders_event_start_delta, events.reminders.recipients AS events_reminders_recipients, events.reminders.send_to_participants AS events_reminders_send_to_participants, events.reminders.send_to_speakers AS events_reminders_send_to_speakers, events.reminders.include_summary AS events_reminders_include_summary, events.reminders.include_description AS events_reminders_include_description, events.reminders.attach_ical AS events_reminders_attach_ical, events.reminders.reply_to_address AS events_reminders_reply_to_address, events.reminders.message AS events_reminders_message 
FROM events.reminders JOIN events.events ON events.events.id = events.reminders.event_id 
WHERE NOT events.reminders.is_sent AND NOT events.events.is_deleted AND events.reminders.scheduled_dt <= %(scheduled_dt_1)s]
[parameters: {'scheduled_dt_1': datetime.datetime(2023, 6, 26, 9, 50, 0, 72913)}]
(Background on this error at: https://sqlalche.me/e/14/f405)
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected         
During handling of the above exception, another exception occurred:
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected         Traceback (most recent call last):
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/handlers.py", line 1065, in emit
    smtp.send_message(msg)
2023-06-26 12:50:00,252  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/smtplib.py", line 986, in send_message
    return self.sendmail(from_addr, to_addrs, flatmsg, mail_options,
2023-06-26 12:50:00,253  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/smtplib.py", line 887, in sendmail
    raise SMTPSenderRefused(code, resp, from_addr)
2023-06-26 12:50:00,253  WARNING  0000000000000000  -       celery.redirected         smtplib.SMTPSenderRefused: (530, b'5.7.1 Authentication required', 'logger@111')
2023-06-26 12:50:00,253  WARNING  0000000000000000  -       celery.redirected         Call stack:
2023-06-26 12:50:00,256  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/bin/indico", line 8, in <module>
    sys.exit(cli())
2023-06-26 12:50:00,256  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/flask/cli.py", line 357, in decorator
    return __ctx.invoke(f, *args, **kwargs)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
2023-06-26 12:50:00,257  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/indico/cli/core.py", line 105, in celery
    celery_cmd(ctx.args)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bin/base.py", line 134, in caller
    return f(ctx, *args, **kwargs)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bin/worker.py", line 351, in worker
    worker.start()
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/worker/worker.py", line 203, in start
    self.blueprint.start(self)
2023-06-26 12:50:00,258  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bootsteps.py", line 116, in start
    step.start(parent)
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/bootsteps.py", line 365, in start
    return self.obj.start()
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/base.py", line 129, in start
    self.on_start()
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/prefork.py", line 109, in on_start
    P = self._pool = Pool(processes=self.limit,
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/asynpool.py", line 463, in __init__
    super().__init__(processes, *args, **kwargs)
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 1046, in __init__
    self._create_worker_process(i)
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/concurrency/asynpool.py", line 480, in _create_worker_process
    return super()._create_worker_process(i)
2023-06-26 12:50:00,259  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 1158, in _create_worker_process
    w.start()
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/process.py", line 124, in start
    self._popen = self._Popen(self)
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/context.py", line 333, in _Popen
    return Popen(process_obj)
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/popen_fork.py", line 24, in __init__
    self._launch(process_obj)
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/popen_fork.py", line 79, in _launch
    code = process_obj._bootstrap()
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/process.py", line 327, in _bootstrap
    self.run()
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 292, in __call__
    sys.exit(self.workloop(pid=pid))
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 313, in sentry_workloop
    return old_workloop(*args, **kwargs)
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/billiard/pool.py", line 362, in workloop
    result = (True, prepare_result(fun(*args, **kwargs)))
2023-06-26 12:50:00,260  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 649, in fast_trace_task
    R, I, T, Rstr = tasks[task].__trace__(
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 208, in _inner
    return f(*args, **kwargs)
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 468, in trace_task
    I, R, state, retval = on_error(task_request, exc, uuid)
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 379, in on_error
    R = I.handle_error_state(
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 178, in handle_error_state
    return {
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 237, in handle_failure
    self._log_error(task, req, einfo)
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 265, in _log_error
    logger.log(policy.severity, policy.format.strip(), context,
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/__init__.py", line 1512, in log
    self._log(level, msg, args, **kwargs)
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/__init__.py", line 1589, in _log
    self.handle(record)
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.pyenv/versions/3.9.17/lib/python3.9/logging/__init__.py", line 1599, in handle
    self.callHandlers(record)
2023-06-26 12:50:00,261  WARNING  0000000000000000  -       celery.redirected           File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/logging.py", line 96, in sentry_patched_callhandlers
    return old_callhandlers(self, record)
2023-06-26 12:50:00,262  WARNING  0000000000000000  -       celery.redirected         Message: 'Task %(name)s[%(id)s] %(description)s: %(exc)s'
Arguments: {'hostname': 'celery@111', 'id': 'd9ee52e1-01eb-4be9-8fd2-fc005e4c1db5', 'name': 'event_reminders', 'exc': 'ProgrammingError(\'(psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist\\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\\n             ^\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context\n    self.dialect.do_execute(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute\n    cursor.execute(statement, parameters)\npsycopg2.errors.UndefinedTable: relation "events.reminders" does not exist\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\n             ^\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 231, in _inner\n    reraise(*exc_info)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 60, in reraise\n    raise value\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 226, in _inner\n    return f(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/core.py", line 138, in __call__\n    rv = super().__call__(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/util.py", line 31, in wrapper\n    return f(*args, **kwargs)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/modules/events/reminders/tasks.py", line 20, in send_event_reminders\n    reminders = (EventReminder.query\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2773, in all\n    return self._iter().all()\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2916, in _iter\n    result = self.session.execute(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1717, in execute\n    result = conn._execute_20(statement, params or {}, execution_options)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1710, in _execute_20\n    return meth(self, args_10style, kwargs_10style, execution_options)\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection\n    return connection._execute_clauseelement(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1577, in _execute_clauseelement\n    ret = self._execute_context(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1948, in _execute_context\n    self._handle_dbapi_exception(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2129, in _handle_dbapi_exception\n    util.raise_(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_\n    raise exception\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context\n    self.dialect.do_execute(\n  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute\n    cursor.execute(statement, parameters)\nsqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\n             ^\n\n[SQL: SELECT events.reminders.id AS events_reminders_id, events.reminders.event_id AS events_reminders_event_id, events.reminders.creator_id AS events_reminders_creator_id, events.reminders.created_dt AS events_reminders_created_dt, events.reminders.scheduled_dt AS events_reminders_scheduled_dt, events.reminders.is_sent AS events_reminders_is_sent, events.reminders.event_start_delta AS events_reminders_event_start_delta, events.reminders.recipients AS events_reminders_recipients, events.reminders.send_to_participants AS events_reminders_send_to_participants, events.reminders.send_to_speakers AS events_reminders_send_to_speakers, events.reminders.include_summary AS events_reminders_include_summary, events.reminders.include_description AS events_reminders_include_description, events.reminders.attach_ical AS events_reminders_attach_ical, events.reminders.reply_to_address AS events_reminders_reply_to_address, events.reminders.message AS events_reminders_message \nFROM events.reminders JOIN events.events ON events.events.id = events.reminders.event_id \nWHERE NOT events.reminders.is_sent AND NOT events.events.is_deleted AND events.reminders.scheduled_dt <= %(scheduled_dt_1)s]\n[parameters: {\'scheduled_dt_1\': datetime.datetime(2023, 6, 26, 9, 50, 0, 72913)}]\n(Background on this error at: https://sqlalche.me/e/14/f405)\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False}
2023-06-26 12:50:00,111  ERROR    0000000000000000  -       celery.app.trace          Task event_reminders[d9ee52e1-01eb-4be9-8fd2-fc005e4c1db5] raised unexpected: ProgrammingError('(psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist\nLINE 2: FROM events.reminders JOIN events.events ON events.events.id...\n             ^\n')
Traceback (most recent call last):
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
psycopg2.errors.UndefinedTable: relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 231, in _inner
    reraise(*exc_info)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/_compat.py", line 60, in reraise
    raise value
  File "/opt/indico/.venv/lib/python3.9/site-packages/sentry_sdk/integrations/celery.py", line 226, in _inner
    return f(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/core.py", line 138, in __call__
    rv = super().__call__(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__
    return self.run(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/core/celery/util.py", line 31, in wrapper
    return f(*args, **kwargs)
  File "/opt/indico/.venv/lib/python3.9/site-packages/indico/modules/events/reminders/tasks.py", line 20, in send_event_reminders
    reminders = (EventReminder.query
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2773, in all
    return self._iter().all()
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2916, in _iter
    result = self.session.execute(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1717, in execute
    result = conn._execute_20(statement, params or {}, execution_options)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1710, in _execute_20
    return meth(self, args_10style, kwargs_10style, execution_options)
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/sql/elements.py", line 334, in _execute_on_connection
    return connection._execute_clauseelement(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1577, in _execute_clauseelement
    ret = self._execute_context(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1948, in _execute_context
    self._handle_dbapi_exception(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2129, in _handle_dbapi_exception
    util.raise_(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1905, in _execute_context
    self.dialect.do_execute(
  File "/opt/indico/.venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedTable) relation "events.reminders" does not exist
LINE 2: FROM events.reminders JOIN events.events ON events.events.id...
             ^

[SQL: SELECT events.reminders.id AS events_reminders_id, events.reminders.event_id AS events_reminders_event_id, events.reminders.creator_id AS events_reminders_creator_id, events.reminders.created_dt AS events_reminders_created_dt, events.reminders.scheduled_dt AS events_reminders_scheduled_dt, events.reminders.is_sent AS events_reminders_is_sent, events.reminders.event_start_delta AS events_reminders_event_start_delta, events.reminders.recipients AS events_reminders_recipients, events.reminders.send_to_participants AS events_reminders_send_to_participants, events.reminders.send_to_speakers AS events_reminders_send_to_speakers, events.reminders.include_summary AS events_reminders_include_summary, events.reminders.include_description AS events_reminders_include_description, events.reminders.attach_ical AS events_reminders_attach_ical, events.reminders.reply_to_address AS events_reminders_reply_to_address, events.reminders.message AS events_reminders_message 
FROM events.reminders JOIN events.events ON events.events.id = events.reminders.event_id 
WHERE NOT events.reminders.is_sent AND NOT events.events.is_deleted AND events.reminders.scheduled_dt <= %(scheduled_dt_1)s]
[parameters: {'scheduled_dt_1': datetime.datetime(2023, 6, 26, 9, 50, 0, 72913)}]
(Background on this error at: https://sqlalche.me/e/14/f405)
4

What’s interesting i’ve did systemctl restart nginx.service indico-celery.service indico-uwsgi.service and it seems like everything is fine, but i still can’t connect via my hostname.

Loaded: loaded (/lib/systemd/system/nginx.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2023-06-26 12:59:11 MSK; 2min 28s ago
       Docs: https://nginx.org/en/docs/
    Process: 6742 ExecStart=/usr/sbin/nginx -c /etc/nginx/nginx.conf (code=exited, status=0/SUCCESS)
   Main PID: 6743 (nginx)
      Tasks: 9 (limit: 9429)
     Memory: 8.2M
        CPU: 14ms
     CGroup: /system.slice/nginx.service
             |-6743 "nginx: master process /usr/sbin/nginx -c /etc/nginx/nginx.conf"
             |-6744 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             |-6745 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             |-6746 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             |-6747 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             |-6748 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             |-6749 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             |-6750 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""
             `-6751 "nginx: worker process" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""

* postgresql.service - PostgreSQL RDBMS
     Loaded: loaded (/lib/systemd/system/postgresql.service; enabled; vendor preset: enabled)
     Active: active (exited) since Mon 2023-06-26 12:42:44 MSK; 18min ago
   Main PID: 1486 (code=exited, status=0/SUCCESS)
        CPU: 934us

* redis-server.service - Advanced key-value store
     Loaded: loaded (/lib/systemd/system/redis-server.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2023-06-26 12:42:42 MSK; 18min ago
       Docs: http://redis.io/documentation,
             man:redis-server(1)
   Main PID: 811 (redis-server)
     Status: "Ready to accept connections"
      Tasks: 5 (limit: 9429)
     Memory: 7.0M
        CPU: 1.641s
     CGroup: /system.slice/redis-server.service
             `-811 "/usr/bin/redis-server 127.0.0.1:6379" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" ""

* indico-celery.service - Indico Celery
     Loaded: loaded (/etc/systemd/system/indico-celery.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2023-06-26 12:59:14 MSK; 2min 26s ago
   Main PID: 6757 (indico)
      Tasks: 10 (limit: 9429)
     Memory: 1005.7M
        CPU: 9.297s
     CGroup: /system.slice/indico-celery.service
             |-6757 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6777 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6781 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6782 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6785 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6786 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6787 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6788 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             |-6789 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B
             `-6790 /opt/indico/.venv/bin/python /opt/indico/.venv/bin/indico celery worker -B

* indico-uwsgi.service - Indico uWSGI
     Loaded: loaded (/etc/systemd/system/indico-uwsgi.service; enabled; vendor preset: enabled)
     Active: active (running) since Mon 2023-06-26 12:59:19 MSK; 2min 20s ago
   Main PID: 6754 (uwsgi)
     Status: "uWSGI is ready"
      Tasks: 9 (limit: 9429)
     Memory: 172.5M
        CPU: 6.189s
     CGroup: /system.slice/indico-uwsgi.service
             |-6754 "indico uWSGI master"
             |-6766 "indico uWSGI worker 1"
             |-6768 "indico uWSGI worker 2"
             |-6770 "indico uWSGI worker 3"
             `-6772 "indico uWSGI worker 4"
lines 21-72/72 (END)
5

This can not work ( you need to start the database before running indico db prepare)
systemctl enable just enables services, but does not auto-start them,AFAIK, so do a systemctl start postgresql.service before running indico db prepare.

As for the problem to reach indico, is the hostname set correctly in indico.conf (BaseURL = <your indico url> and in the nginx config (server_name entries in site.conf )?

6

Thank you, i’ve found out that i should’ve recreate db with UTF-8 encoding and then everything worked out

7

Just wondering… we check for this when running indico db prepare. Did you get an error there?