jqdata初次运行出现错误

```
2022-02-15 18:00:57,348 root|stock_daily.import_jq_stock_daily:148 WARNING jq_stock_daily_md_pre 不存在，仅使用 jq_stock_info 表进行计算日期范围
2022-02-15 18:00:57,413 root|stock_daily.import_jq_stock_daily:182 INFO 4761 data will been import into jq_stock_daily_md_pre
2022-02-15 18:00:57,413 root|stock_daily.import_jq_stock_daily:229 ERROR 000001.XSHE [1991-04-03 - 2022-02-15]
Traceback (most recent call last):
  File "F:\data_integration_celery\tasks\jqdata\stock\stock_daily.py", line 191, in import_jq_stock_daily
    date_from = get_first(trade_date_list, lambda x: x >= date_from_tmp)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\ibats_utils\mess.py", line 470, in get_first
    if func(n):
  File "F:\data_integration_celery\tasks\jqdata\stock\stock_daily.py", line 191, in <lambda>
    date_from = get_first(trade_date_list, lambda x: x >= date_from_tmp)
TypeError: '>=' not supported between instances of 'str' and 'datetime.date'
2022-02-15 18:00:57,415 tasks.jqdata.stock.available_check.check|check.check_all:34 DEBUG 1/4) 检查 jq_stock_daily_md_pre
2022-02-15 18:00:57,418 tasks.jqdata.stock.available_check|__init__.check_diff:60 WARNING jq_stock_daily_md_pre 表不存在无需检查
2022-02-15 18:00:57,420 tasks.jqdata.stock.available_check.check|check.check_all:34 DEBUG 2/4) 检查 jq_stock_balance
2022-02-15 18:00:57,427 tasks.jqdata.stock.available_check|__init__.check_diff:67 WARNING jq_stock_balance_bak 表不存在无需检查
2022-02-15 18:00:57,532 tasks.jqdata.stock.available_check|__init__.backup_table:43 DEBUG 创建 jq_stock_balance_bak 表
2022-02-15 18:01:07,498 tasks.jqdata.stock.available_check|__init__.backup_table:48 INFO jq_stock_balance_bak 导入 422704 条记录
2022-02-15 18:01:07,499 tasks.jqdata.stock.available_check.check|check.check_all:34 DEBUG 3/4) 检查 jq_stock_cashflow
2022-02-15 18:01:07,508 tasks.jqdata.stock.available_check|__init__.check_diff:67 WARNING jq_stock_cashflow_bak 表不存在无需检查
2022-02-15 18:01:07,544 tasks.jqdata.stock.available_check|__init__.backup_table:43 DEBUG 创建 jq_stock_cashflow_bak 表
2022-02-15 18:01:15,061 tasks.jqdata.stock.available_check|__init__.backup_table:48 INFO jq_stock_cashflow_bak 导入 378241 条记录
2022-02-15 18:01:15,063 tasks.jqdata.stock.available_check.check|check.check_all:34 DEBUG 4/4) 检查 jq_stock_income
2022-02-15 18:01:15,071 tasks.jqdata.stock.available_check|__init__.check_diff:67 WARNING jq_stock_income_bak 表不存在无需检查
2022-02-15 18:01:15,096 tasks.jqdata.stock.available_check|__init__.backup_table:43 DEBUG 创建 jq_stock_income_bak 表
2022-02-15 18:01:22,649 tasks.jqdata.stock.available_check|__init__.backup_table:48 INFO jq_stock_income_bak 导入 423523 条记录
2022-02-15 18:01:22,651 tasks.jqdata.stock.available_check.check|check.check_all:37 INFO 检查结果：
2022-02-15 18:01:22,652 tasks.jqdata.stock.available_check.check|check.check_all:39 INFO 1/4) jq_stock_daily_md_pre 检查 通过
2022-02-15 18:01:22,653 tasks.jqdata.stock.available_check.check|check.check_all:39 INFO 2/4) jq_stock_balance 检查 通过
2022-02-15 18:01:22,653 tasks.jqdata.stock.available_check.check|check.check_all:39 INFO 3/4) jq_stock_cashflow 检查 通过
2022-02-15 18:01:22,654 tasks.jqdata.stock.available_check.check|check.check_all:39 INFO 4/4) jq_stock_income 检查 通过
Traceback (most recent call last):
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 1193, in _execute_context
    context)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\default.py", line 508, in do_execute
    cursor.execute(statement, parameters)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\MySQLdb\cursors.py", line 193, in execute
    res = self._query(query)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\MySQLdb\cursors.py", line 299, in _query
    db.query(q)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\MySQLdb\connections.py", line 217, in query
    _mysql.connection.query(self, query)
MySQLdb._exceptions.OperationalError: (1054, "Unknown column 'report.dother_equity_tools' in 'field list'")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\quant\anaconda3\envs\celery\lib\runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "C:\Users\quant\anaconda3\envs\celery\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "F:\data_integration_celery\tasks\__init__.py", line 190, in <module>
    main()
  File "F:\data_integration_celery\tasks\__init__.py", line 186, in main
    finished = task_choose(standalone_mode=False)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\click\core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\click\core.py", line 782, in main
    rv = self.invoke(ctx)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\click\core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\click\core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "F:\data_integration_celery\tasks\__init__.py", line 181, in task_choose
    func_list[num - 1][0]()
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\celery\local.py", line 188, in __call__
    return self._get_current_object()(*a, **kw)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\celery\app\task.py", line 389, in __call__
    return self.run(*args, **kwargs)
  File "F:\data_integration_celery\tasks\jqdata\app_tasks.py", line 83, in jq_tasks_local_first_time
    jq_tasks_local(True)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\celery\local.py", line 188, in __call__
    return self._get_current_object()(*a, **kw)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\celery\app\task.py", line 389, in __call__
    return self.run(*args, **kwargs)
  File "F:\data_integration_celery\tasks\jqdata\app_tasks.py", line 93, in jq_tasks_local
    run_finance_2_daily_job_local()
  File "F:\data_integration_celery\tasks\jqdata\app_tasks.py", line 60, in run_finance_2_daily_job_local
    save_2_daily_balance()
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\celery\local.py", line 188, in __call__
    return self._get_current_object()(*a, **kw)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\celery\app\task.py", line 389, in __call__
    return self.run(*args, **kwargs)
  File "F:\data_integration_celery\tasks\jqdata\stock\finance_report\balance_2_daily.py", line 35, in save_2_daily_balance
    TABLE_NAME_FIN_REPORT, TABLE_NAME, TABLE_NAME_TRADE_DATE, DTYPE, ACCUMULATION_COL_NAME_LIST)
  File "F:\data_integration_celery\tasks\jqdata\stock\finance_report\__init__.py", line 497, in transfer_report_2_daily
    dfg_by_code = pd.read_sql(sql_str, engine_md).set_index('report_date', drop=False).sort_index().groupby('code')
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\pandas\io\sql.py", line 397, in read_sql
    chunksize=chunksize)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\pandas\io\sql.py", line 1099, in read_query
    result = self.execute(*args)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\pandas\io\sql.py", line 990, in execute
    return self.connectable.execute(*args, **kwargs)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 2075, in execute
    return connection.execute(statement, *multiparams, **params)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 942, in execute
    return self._execute_text(object, multiparams, params)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 1104, in _execute_text
    statement, parameters
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 1200, in _execute_context
    context)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 1413, in _handle_dbapi_exception
    exc_info
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\util\compat.py", line 203, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\util\compat.py", line 186, in reraise
    raise value.with_traceback(tb)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\base.py", line 1193, in _execute_context
    context)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\sqlalchemy\engine\default.py", line 508, in do_execute
    cursor.execute(statement, parameters)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\MySQLdb\cursors.py", line 193, in execute
    res = self._query(query)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\MySQLdb\cursors.py", line 299, in _query
    db.query(q)
  File "C:\Users\quant\anaconda3\envs\celery\lib\site-packages\MySQLdb\connections.py", line 217, in query
    _mysql.connection.query(self, query)
sqlalchemy.exc.OperationalError: (MySQLdb._exceptions.OperationalError) (1054, "Unknown column 'report.dother_equity_tools' in 'field list'") [SQL: 'SELECT report.`id` id,report.`code` code,report.`pub_date` pub_date,report.`end_date` end_date,report.`report_date` report_date,report.`report_type` report_type,report.`source_id` source_id,report.`cash_equivalents` cash_equivalents,report.`trading_assets` trading_assets,report.`bill_receivable` bill_receivable,report.`account_receivable` account_receivable,report.`advance_payment` advance_payment,report.`other_receivable` other_receivable,report.`affiliated_company_receivable` affiliated_company_receivable,report.`interest_receivable` interest_receivable,report.`dividend_receivable` dividend_receivable,report.`inventories` inventories,report.`expendable_biological_asset` expendable_biological_asset,report.`non_current_asset_in_one_year` non_current_asset_in_one_year,report.`total_current_assets` total_current_assets,report.`hold_for_sale_assets` hold_for_sale_assets,report.`hold_to_maturity_investments` hold_to_maturity_investments,report.`longterm_receivable_account` longterm_receivable_account,report.`longterm_equity_invest` longterm_equity_invest,report.`investment_property` investment_property,report.`fixed_assets` fixed_assets,report.`constru_in_process` constru_in_process,report.`construction_materials` construction_materials,report.`fixed_assets_liquidation` fixed_assets_liquidation,report.`biological_assets` biological_assets,report.`oil_gas_assets` oil_gas_assets,report.`intangible_assets` intangible_assets,report.`development_expenditure` development_expenditure,report.`good_will` good_will,report.`long_deferred_expense` long_deferred_expense,report.`deferred_tax_assets` deferred_tax_assets,report.`total_non_current_assets` total_non_current_assets,report.`total_assets` total_assets,report.`shortterm_loan` shortterm_loan,report.`trading_liability` trading_liability,report.`notes_payable` notes_payable,report.`accounts_payable` accounts_payable,report.`advance_peceipts` advance_peceipts,report.`salaries_payable` salaries_payable,report.`taxs_payable` taxs_payable,report.`interest_payable` interest_payable,report.`dividend_payable` dividend_payable,report.`other_payable` other_payable,report.`affiliated_company_payable` affiliated_company_payable,report.`non_current_liability_in_one_year` non_current_liability_in_one_year,report.`total_current_liability` total_current_liability,report.`longterm_loan` longterm_loan,report.`bonds_payable` bonds_payable,report.`longterm_account_payable` longterm_account_payable,report.`specific_account_payable` specific_account_payable,report.`estimate_liability` estimate_liability,report.`deferred_tax_liability` deferred_tax_liability,report.`total_non_current_liability` total_non_current_liability,report.`total_liability` total_liability,report.`paidin_capital` paidin_capital,report.`capital_reserve_fund` capital_reserve_fund,report.`specific_reserves` specific_reserves,report.`surplus_reserve_fund` surplus_reserve_fund,report.`treasury_stock` treasury_stock,report.`retained_profit` retained_profit,report.`equities_parent_company_owners` equities_parent_company_owners,report.`minority_interests` minority_interests,report.`foreign_currency_report_conv_diff` foreign_currency_report_conv_diff,report.`irregular_item_adjustment` irregular_item_adjustment,report.`total_owner_equities` total_owner_equities,report.`total_sheet_owner_equities` total_sheet_owner_equities,report.`other_comprehensive_income` other_comprehensive_income,report.`deferred_earning` deferred_earning,report.`settlement_provi` settlement_provi,report.`lend_capital` lend_capital,report.`loan_and_advance_current_assets` loan_and_advance_current_assets,report.`derivative_financial_asset` derivative_financial_asset,report.`insurance_receivables` insurance_receivables,report.`reinsurance_receivables` reinsurance_receivables,report.`reinsurance_contract_reserves_receivable` reinsurance_contract_reserves_receivable,report.`bought_sellback_assets` bought_sellback_assets,report.`hold_sale_asset` hold_sale_asset,report.`loan_and_advance_noncurrent_assets` loan_and_advance_noncurrent_assets,report.`borrowing_from_centralbank` borrowing_from_centralbank,report.`deposit_in_interbank` deposit_in_interbank,report.`borrowing_capital` borrowing_capital,report.`derivative_financial_liability` derivative_financial_liability,report.`sold_buyback_secu_proceeds` sold_buyback_secu_proceeds,report.`commission_payable` commission_payable,report.`reinsurance_payables` reinsurance_payables,report.`insurance_contract_reserves` insurance_contract_reserves,report.`proxy_secu_proceeds` proxy_secu_proceeds,report.`receivings_from_vicariously_sold_securities` receivings_from_vicariously_sold_securities,report.`hold_sale_liability` hold_sale_liability,report.`estimate_liability_current` estimate_liability_current,report.`deferred_earning_current` deferred_earning_current,report.`preferred_shares_noncurrent` preferred_shares_noncurrent,report.`pepertual_liability_noncurrent` pepertual_liability_noncurrent,report.`longterm_salaries_payable` longterm_salaries_payable,report.`dother_equity_tools` dother_equity_tools,report.`preferred_shares_equity` preferred_shares_equity,report.`pepertual_liability_equity` pepertual_liability_equity FROM jq_stock_balance report inner join \n        (\n            select code, pub_date, max(report_date) report_date \n            from jq_stock_balance where report_type=0 group by code, pub_date\n        ) base_date\n        where report.report_type=0\n        and report.code = base_date.code\n        and report.pub_date = base_date.pub_date\n        and report.report_date = base_date.report_date\n        order by code, pub_date'] (Background on this error at: http://sqlalche.me/e/e3q8)
```

我将report.other_comprehensive_income改成了正确拼写，于是:

```
MySQLdb._exceptions.OperationalError: (1054, "Unknown column 'report.dother_equity_tools' in 'field list'")
```
否则报错是

```
MySQLdb._exceptions.OperationalError: (1054, "Unknown column 'report.other_comprehesive_income' in 'field list'")
```

DataIntegrationAlliance/data_integration_celery

内容风险标识

评论 (3)

DataIntegrationAlliance/data_integration_celery .gitee-modal { width: 500px !important; }

内容风险标识