Hello, seeing you have renamed the `Echo` task to more fitting `Log` () recently, I was wondering about the (really awesome) task. Its semantic is more like a CLI/Shell since it allows using different interpreters. Besides, it defaults to `/bin/sh` - so not really Bash like its name suggests. This is just a detail but still :slightly_smiling_face:

Am I missing a simple way of conditionally executing task(s)? I'm aware of the `io.kestra.core.tasks.flows.Switch` but that is a value-based switch statement. Using the switch leads to rather odd constructions with a lot of boiler plate code. This simple example looks very non-idiomatic: ``` - id: run-X-when-necessary type: io.kestra.core.tasks.flows.Switch value: "{{ inputs contains 'aVariableConnectedToX' ? 'RUN' : 'SKIP' }}" cases: RUN: - id: run-X type: io.kestra.core.tasks.debugs.Echo description: "Run X" format: "Running X with {{ inputs.aVariableConnectedToX }}..." defaults: - id: skipping-X type: io.kestra.core.tasks.debugs.Echo description: "Switch requires to have a task to execute" format: "Skipping X..."``` Is there a more direct way to execute the listed `run-X` task only when we have a related input defined?

is there any plan to allow integration with something like datahub

Is there a way to see all variables `outputs` , `envs` , `trigger` ... etc ? It should be very useful for debugging

Hello, on the I see that I can use payload with `trigger.variables.body` `trigger.variables.headers` but it seems that it's just `trigger.body` and `trigger.headers` . No ?

@lmathieu do you know if there is a way to add import python files into a task let's say I have 10 modules i Need in the main.py. what's the best way to add them ?

hi guys, where are the yaml files store in kestra folder?

I got it I can just use return to format it from the table output `id: count-rows` `namespace: io.priam.paolo` `description: |` `Count rows from the streaming tables.` `tasks:` `- id: countDetections` `type: io.kestra.plugin.jdbc.postgresql.Query` `url: jdbc:` `username: admin` `password: admin` `sql: SELECT count(*) AS total FROM detections` `fetch: true` `- id: display-counts` `type: "io.kestra.core.tasks.debugs.Return"` `format: "{% for row in outputs.countDetections.rows %} Total detections = {{row.total}} {% endfor %}"`

Hello @ldehon, the kestra project of my local computer is printed into a binary file and executed An error is reported after the command _./kestra server executor_. But execute The _./kestra server webserver_ can run normally. Please help me look at this question. Thank you. The mysql plugin has been downloaded and configured correctly. Execution The logs of _./kestra server webserver_ are as follows: `$ ./kestra server webserver` 2023-02-13 16:02:26,073 [34mINFO [0;39m [35mmain [0;39m [36mi.m.context.env.DefaultEnvironment[0;39m Established active environments: [cli] 2023-02-13 16:02:27,322 [34mINFO [0;39m [35mmain [0;39m [36mcom.zaxxer.hikari.HikariDataSource[0;39m HikariPool-1 - Starting... 2023-02-13 16:02:27,987 [34mINFO [0;39m [35mmain [0;39m [36mcom.zaxxer.hikari.HikariDataSource[0;39m HikariPool-1 - Start completed. 2023-02-13 16:02:29,148 [34mINFO [0;39m [35mwebserver [0;39m [36mio.kestra.cli.AbstractCommand[0;39m Starting Kestra with environments [cli] 2023-02-13 16:02:30,438 [34mINFO [0;39m [35mwebserver [0;39m [36mio.kestra.cli.AbstractCommand[0;39m Server Running: , Management server on port 2023-02-13 16:02:30,439 [34mINFO [0;39m [35mwebserver [0;39m [36mi.k.c.c.servers.WebServerCommand[0;39m Webserver started Execution The logs of _./kestra server executor_ are as follows: `2023-02-13 15:31:57,883 [34mINFO [0;39m [35mmain [0;39m [36mi.m.context.env.DefaultEnvironment[0;39m Established active environments: [cli]` 2023-02-13 15:31:59,015 [34mINFO [0;39m [35mmain [0;39m [36mcom.zaxxer.hikari.HikariDataSource[0;39m HikariPool-1 - Starting... 2023-02-13 15:31:59,478 [34mINFO [0;39m [35mmain [0;39m [36mcom.zaxxer.hikari.HikariDataSource[0;39m HikariPool-1 - Start completed. 2023-02-13 15:32:00,223 [34mINFO [0;39m [35mexecutor [0;39m [36mio.kestra.cli.AbstractCommand[0;39m Starting Kestra with environments [cli] 2023-02-13 15:32:01,285 [34mINFO [0;39m [35mexecutor [0;39m [36mio.kestra.cli.AbstractCommand[0;39m Server Running: , Management server on port 2023-02-13 15:32:02,512 [34mINFO [0;39m [35mexecutor [0;39m [36morg.jooq.Constants[0;39m @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@@@@@@@ @@ @@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@ @@@@@@@@@@@@@@@@ @@ @@ @@@@@@@@@@ @@@@@@@@@@ @@@@ @@ @@ @@@@@@@@@@ @@@@@@@@@@ @@ @@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@ @@ @@@@@@@@@@ @@@@@@@@@@ @@ @@ @@@@ @@@@@@@@@@ @@@@@@@@@@ @@ @@ @@@@ @@@@@@@@@@ @@@@@@@@@@ @@ @ @ @@@@@@@@@@ @@@@@@@@@@ @@ @@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ Thank you for using jOOQ 3.14.12 [31m[1mio.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type [io.kestra.jdbc.runner.JdbcExecutor] Message: com.fasterxml.jackson.databind.exc.InvalidTypeIdException: Could not resolve type id 'io.kestra.plugin.jdbc.mysql.Query' as a subtype of `io.kestra.core.models.tasks.Task`: no such class found at [Source: (String)"{"id": "txt2KQ1dYZgPqhlvEeKTL61ct", "tasks": [{"id": "t1", "type": "io.kestra.core.tasks.scripts.Bash", "commands": ["cat file.tmp > {{ outputFiles.outFile }}"], "inputFiles": {"file.tmp": "{{ inputs.file }}"}, "outputFiles": ["outFile"]}, {"id": "txt_2KQ1dYZgPqhlvEeKTL61ct", "sql": "LOAD DATA LOCAL INFILE '{{ inputFile }}' \nINTO TABLE lihaipeng.test19_bt_bill \nFIELDS TERMINATED BY ',' \nENCLOSED BY '\"'\nLINES TERMINATED BY '\\n'\nIGNORE 1 ROWS;", "url": "jdbc:"[truncated 319 chars]; line: 1, column: 530] (through reference chain: io.kestra.core.models.flows.Flow["tasks"]->java.util.ArrayList[1]) Path Taken: new JdbcExecutor() --> JdbcExecutor.flowListeners[21m[39m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2346)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2284)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2230)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:2995)[23m[0m [3m at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:2897)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2858)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2779)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1596)[23m[0m [3m at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:66)[23m[0m [3m at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2069)[23m[0m [3m at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForField(AbstractInitializableBeanDefinition.java:1606)[23m[0m [3m at io.kestra.jdbc.runner.$JdbcExecutor$Definition.injectBean(Unknown Source)[23m[0m [3m at io.kestra.jdbc.runner.$JdbcExecutor$Definition.build(Unknown Source)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2333)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2284)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2230)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:2995)[23m[0m [3m at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:2897)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2858)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2779)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1596)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:865)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:857)[23m[0m [3m at io.kestra.cli.commands.servers.ExecutorCommand.call(ExecutorCommand.java:34)[23m[0m [3m at io.kestra.cli.commands.servers.ExecutorCommand.call(ExecutorCommand.java:14)[23m[0m [3m at picocli.CommandLine.executeUserObject(CommandLine.java:1953)[23m[0m [3m at picocli.CommandLine.access$1300(CommandLine.java:145)[23m[0m [3m at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2358)[23m[0m [3m at picocli.CommandLine$RunLast.handle(CommandLine.java:2352)[23m[0m [3m at picocli.CommandLine$RunLast.handle(CommandLine.java:2314)[23m[0m [3m at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)[23m[0m [3m at picocli.CommandLine$RunLast.execute(CommandLine.java:2316)[23m[0m [3m at picocli.CommandLine.execute(CommandLine.java:2078)[23m[0m [3m at io.kestra.cli.App.execute(App.java:67)[23m[0m [3m at io.kestra.cli.App.main(App.java:47)[23m[0m [31m[1mCaused by: java.lang.RuntimeException: com.fasterxml.jackson.databind.exc.InvalidTypeIdException: Could not resolve type id 'io.kestra.plugin.jdbc.mysql.Query' as a subtype of `io.kestra.core.models.tasks.Task`: no such class found at [Source: (String)"{"id": "txt2KQ1dYZgPqhlvEeKTL61ct", "tasks": [{"id": "t1", "type": "io.kestra.core.tasks.scripts.Bash", "commands": ["cat file.tmp > {{ outputFiles.outFile }}"], "inputFiles": {"file.tmp": "{{ inputs.file }}"}, "outputFiles": ["outFile"]}, {"id": "txt_2KQ1dYZgPqhlvEeKTL61ct", "sql": "LOAD DATA LOCAL INFILE '{{ inputFile }}' \nINTO TABLE lihaipeng.test19_bt_bill \nFIELDS TERMINATED BY ',' \nENCLOSED BY '\"'\nLINES TERMINATED BY '\\n'\nIGNORE 1 ROWS;", "url": "jdbc:"[truncated 319 chars]; line: 1, column: 530] (through reference chain: io.kestra.core.models.flows.Flow["tasks"]->java.util.ArrayList[1])[21m[39m[0m [3m at io.kestra.jdbc.AbstractJdbcRepository.map(AbstractJdbcRepository.java:195)[23m[0m [3m at org.jooq.impl.ResultImpl.map(ResultImpl.java:1313)[23m[0m [3m at io.kestra.jdbc.AbstractJdbcRepository.fetch(AbstractJdbcRepository.java:213)[23m[0m [3m at io.kestra.jdbc.repository.AbstractJdbcFlowRepository.lambda$findAll$3(AbstractJdbcFlowRepository.java:139)[23m[0m [3m at org.jooq.impl.DefaultDSLContext.lambda$transactionResult0$0(DefaultDSLContext.java:543)[23m[0m [3m at org.jooq.impl.Tools$35$1.block(Tools.java:5246)[23m[0m [3m at java.base/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3128)[23m[0m [3m at org.jooq.impl.Tools$35.get(Tools.java:5243)[23m[0m [3m at org.jooq.impl.DefaultDSLContext.transactionResult0(DefaultDSLContext.java:595)[23m[0m [3m at org.jooq.impl.DefaultDSLContext.transactionResult(DefaultDSLContext.java:512)[23m[0m [3m at io.kestra.jdbc.JooqDSLContextWrapper.lambda$transactionResult$2(JooqDSLContextWrapper.java:80)[23m[0m [3m at net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)[23m[0m [3m at net.jodah.failsafe.RetryPolicyExecutor.lambda$supply$0(RetryPolicyExecutor.java:66)[23m[0m [3m at net.jodah.failsafe.FallbackExecutor.lambda$supply$0(FallbackExecutor.java:45)[23m[0m [3m at net.jodah.failsafe.Execution.executeSync(Execution.java:128)[23m[0m [3m at net.jodah.failsafe.FailsafeExecutor.call(FailsafeExecutor.java:379)[23m[0m [3m at net.jodah.failsafe.FailsafeExecutor.get(FailsafeExecutor.java:68)[23m[0m [3m at io.kestra.core.utils.RetryUtils$Instance.wrap(RetryUtils.java:134)[23m[0m [3m at io.kestra.core.utils.RetryUtils$Instance.runRetryIf(RetryUtils.java:93)[23m[0m [3m at io.kestra.jdbc.JooqDSLContextWrapper.transactionResult(JooqDSLContextWrapper.java:78)[23m[0m [3m at io.kestra.jdbc.repository.AbstractJdbcFlowRepository.findAll(AbstractJdbcFlowRepository.java:132)[23m[0m [3m at io.kestra.core.runners.FlowListeners.<init>(FlowListeners.java:39)[23m[0m [3m at io.kestra.core.runners.$FlowListeners$Definition.build(Unknown Source)[23m[0m [3m at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2333)[23m[0m [3m ... 36 more[23m[0m [31m[1mCaused by: com.fasterxml.jackson.databind.exc.InvalidTypeIdException: Could not resolve type id 'io.kestra.plugin.jdbc.mysql.Query' as a subtype of `io.kestra.core.models.tasks.Task`: no such class found at [Source: (String)"{"id": "txt2KQ1dYZgPqhlvEeKTL61ct", "tasks": [{"id": "t1", "type": "io.kestra.core.tasks.scripts.Bash", "commands": ["cat file.tmp > {{ outputFiles.outFile }}"], "inputFiles": {"file.tmp": "{{ inputs.file }}"}, "outputFiles": ["outFile"]}, {"id": "txt_2KQ1dYZgPqhlvEeKTL61ct", "sql": "LOAD DATA LOCAL INFILE '{{ inputFile }}' \nINTO TABLE lihaipeng.test19_bt_bill \nFIELDS TERMINATED BY ',' \nENCLOSED BY '\"'\nLINES TERMINATED BY '\\n'\nIGNORE 1 ROWS;", "url": "jdbc:"[truncated 319 chars]; line: 1, column: 530] (through reference chain: io.kestra.core.models.flows.Flow["tasks"]->java.util.ArrayList[1])[21m[39m[0m

Found another reason Kestra Yaml parser should not remove valid code :angel: (I already wrote on this subject here : ) The other issue I found, take this small code: ```- id: log_file type: io.kestra.core.tasks.debugs.Echo format: "File: {{ taskrun.value }}" level: INFO``` Kestra Parser will clean it up as this (removed the *level* attribute): ```- id: log_file type: io.kestra.core.tasks.debugs.Echo format: "File: {{ taskrun.value }}"``` As I understand it the parser removed explicitly written default value of an attribute. This is a big issue because • Default value could change between Kestra version • Terraform tfstate file will contain something different than what it is written on my repo The consequences of these two things are: First, my production code could not work the same as before. For example tomorrow the default value move from INFO to DEBUG. All my INFO logs have been moved without any input on my side and my code. And if I explicitly try to protect against this, Kestra will forbid me to do that :cry: Second, everytime I will deploy using terraform, the Kestra provider will redeploy my flow since the tfstate definition of my ressource and my source code are different. So my terraform plan will not be easily readable if I have like 100 Kestra flow and everytime I update one all these flows will be redeployed because of the parser. ...And my flow revision will be incremented everytime I guess :cry: I don't say don't try to parse the yaml and clean it up, what I am saying is please don't turn the parser to eleven and make the work more difficult and not easier for a developer :wink: Still loving Kestra though :heart: