首页 文章

如何在spring-batch中拆分和连接流以配置作业中的设置和拆卸步骤

提问于
浏览 次
2

我已经回顾了Spring-batch flow / split after a step，发现（a）标记的解决方案没有解析因为拆分无法访问，而且（b）我的用例不同，所以答案的意图是不同的 .

我还审查了How to configure mentioned use case using spring batch parallel step split flow?，但解决方法是增加并行化，而不是拆分和连接线程 .

这似乎是一个常见的用例，它应该是一个FAQ，但我还没有看到解决方案 .

我有一个并行化的 spring 批处理作业，我想添加设置和拆卸步骤 . 设置和teatdown是单线程，但主体工作是并行的 .

随着时间的推移，事件的图表不同：

start        setup
               |
split       -------
            |     |
         some    other
         stuff   stuff
            |     |
join        -------
               |
finish      teardown

我开始的 spring 批处理作业XML是：

<batch:job id="myJob">

    <batch:step id="step0001-setup">
        <batch:tasklet transaction-manager="jtaTransactionManager"
            start-limit="100" allow-start-if-complete="true">
            <batch:chunk reader="beforeJobScriptExecutor" writer="dummySinkWriter"
                commit-interval="1" />
        </batch:tasklet>
    </batch:step>


    <batch:split id="split1" task-executor="taskExecutor" next="step9999">

        <batch:flow>
            <batch:step id="step0003-one-thread"
                allow-start-if-complete="true">
                <batch:tasklet transaction-manager="jtaTransactionManager"
                    start-limit="100">
                    <batch:chunk reader="myReader1" writer="myWriter1"
                        commit-interval="1" />
                </batch:tasklet>
            </batch:step>
        </batch:flow>

        <batch:flow>
            <batch:step id="step0002-another-thread">
                <batch:tasklet transaction-manager="jtaTransactionManager"
                    start-limit="100">
                    <batch:chunk reader="myReader2" writer="myWriter2"
                        commit-interval="1" />
                </batch:tasklet>
            </batch:step>
        </batch:flow>

    </batch:split>


    <batch:step id="step9999">
        <batch:tasklet transaction-manager="jtaTransactionManager"
            start-limit="100" allow-start-if-complete="true">
            <batch:chunk reader="afterJobScriptExecutor" writer="dummySinkWriter"
                commit-interval="1" />
        </batch:tasklet>
    </batch:step>
</batch:job>
java spring multithreading spring-batch

1 回答

  • 0

    解决方案主要在这篇文章中概述：How to terminate Step within a Spring Batch Split Flow with a Decider

    spring 批作业的最终文本是这样的：

    <batch:job id="myJob">

    <batch:step id="step0001-setup">
        <batch:tasklet transaction-manager="jtaTransactionManager"
            start-limit="100" allow-start-if-complete="true">
            <batch:chunk reader="beforeJobScriptExecutor" writer="dummySinkWriter"
                commit-interval="1" />
        </batch:tasklet>
        <batch:end on="FAILED" />
        <batch:next on="*" to="split1" />
    </batch:step>


    <batch:split id="split1" task-executor="taskExecutor" next="step9999">

        <batch:flow>
            <batch:step id="step0003-one-thread"
                allow-start-if-complete="true">
                <batch:tasklet transaction-manager="jtaTransactionManager"
                    start-limit="100">
                    <batch:chunk reader="myReader1" writer="myWriter1"
                        commit-interval="1" />
                </batch:tasklet>
            </batch:step>
        </batch:flow>

        <batch:flow>
            <batch:step id="step0002-another-thread">
                <batch:tasklet transaction-manager="jtaTransactionManager"
                    start-limit="100">
                    <batch:chunk reader="myReader2" writer="myWriter2"
                        commit-interval="1" />
                </batch:tasklet>
            </batch:step>
        </batch:flow>

    </batch:split>


    <batch:step id="step9999">
        <batch:tasklet transaction-manager="jtaTransactionManager"
            start-limit="100" allow-start-if-complete="true">
            <batch:chunk reader="afterJobScriptExecutor" writer="dummySinkWriter"
                commit-interval="1" />
        </batch:tasklet>
    </batch:step>
</batch:job>
    回复于

相关问题