Skip to content

Commit ca72f2d

Browse files
committed
first final
1 parent fe07705 commit ca72f2d

File tree

7 files changed

+82
-36
lines changed

7 files changed

+82
-36
lines changed

.idea/workspace.xml

+42-28
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
29 Bytes
Binary file not shown.
2.56 KB
Binary file not shown.

docs/_build/html/_sources/jobSubmit.rst.txt

+13-3
Original file line numberDiff line numberDiff line change
@@ -52,6 +52,16 @@ SelectTransformation等等.具体的使用场景如下:
5252

5353
Client
5454
-------------
55-
Words can have *emphasis in italics* or be **bold** and you can define
56-
code samples with back quotes, like when you talk about a command: ``sudo``
57-
gives you super user powers!
55+
Client模块的入口为CliFrontend,用于接收和处理各种命令与请求,如Run和Cancel代表运行和取消任务,CliFrontend在收到对应命令后,根据参数来具体执行命令.
56+
Run命令中必须执行Jar和Class,也可指定SavePoint目录来恢复任务.
57+
58+
Client会根据Jar来提取出Plan,即DataFlow.然后在此Plan的基础上生成JobGraph.其主要操作是对StreamGraph进行优化,将能chain在一起的Operator进行Chain在一起的操作.
59+
在得到JobGraph后就会提交JobGraph等内容,为任务的运行做准备.
60+
Operator能chain在一起的条件:
61+
#. 上下游Operator的并行度一致
62+
#. 下游节点的入度为1
63+
#. 上下游节点都在同一个SlotSharingGroup中(默认为default)
64+
#. 下游节点的chain策略是ALWAYS(可以与上下游链接,map/flatmap/filter等默认是ALWAYS)
65+
#. 上游节点的chain策略是ALWAYS或HEAD(只能与下游链接,不能与上游链接,source默认是HEAD)
66+
#. 两个Operator间的数据分区方式是fowward
67+
#. 用户没有禁用chain

docs/_build/html/jobSubmit.html

+16-3
Original file line numberDiff line numberDiff line change
@@ -205,9 +205,22 @@ <h2>生成StreamGraph<a class="headerlink" href="#streamgraph" title="Permalink
205205
</div>
206206
<div class="section" id="client">
207207
<h2>Client<a class="headerlink" href="#client" title="Permalink to this headline"></a></h2>
208-
<p>Words can have <em>emphasis in italics</em> or be <strong>bold</strong> and you can define
209-
code samples with back quotes, like when you talk about a command: <code class="docutils literal notranslate"><span class="pre">sudo</span></code>
210-
gives you super user powers!</p>
208+
<p>Client模块的入口为CliFrontend,用于接收和处理各种命令与请求,如Run和Cancel代表运行和取消任务,CliFrontend在收到对应命令后,根据参数来具体执行命令.
209+
Run命令中必须执行Jar和Class,也可指定SavePoint目录来恢复任务.</p>
210+
<p>Client会根据Jar来提取出Plan,即DataFlow.然后在此Plan的基础上生成JobGraph.其主要操作是对StreamGraph进行优化,将能chain在一起的Operator进行Chain在一起的操作.
211+
在得到JobGraph后就会提交JobGraph等内容,为任务的运行做准备.
212+
Operator能chain在一起的条件:</p>
213+
<blockquote>
214+
<div><ol class="arabic simple">
215+
<li><p>上下游Operator的并行度一致</p></li>
216+
<li><p>下游节点的入度为1</p></li>
217+
<li><p>上下游节点都在同一个SlotSharingGroup中(默认为default)</p></li>
218+
<li><p>下游节点的chain策略是ALWAYS(可以与上下游链接,map/flatmap/filter等默认是ALWAYS)</p></li>
219+
<li><p>上游节点的chain策略是ALWAYS或HEAD(只能与下游链接,不能与上游链接,source默认是HEAD)</p></li>
220+
<li><p>两个Operator间的数据分区方式是fowward</p></li>
221+
<li><p>用户没有禁用chain</p></li>
222+
</ol>
223+
</div></blockquote>
211224
</div>
212225
</div>
213226

0 commit comments

Comments
 (0)