Skip to content

Commit c0364ec

Browse files
sdoirepostlight-orgflbn
authored
feat: update all fixtures and custom parsers to match (#713)
* feat: Refactor and update fixtures This patch changes how fixtures are stored. Previously, a fixture's folder identified its domain and its filename identified when it was fetched. This has been changed so that the filename indicates the domain and the modified time of the file indicates how recently it was fetched. A fixture's filename can optionally include a modifier to distinguish between two different page types on the same domain, for example. Also included here are changes to the update-fixture script, both to accomodate the new filename scheme as well as to actually update all fixtures. The functionality for running automatically and opening PRs has been removed but will likely be reintroduced. Finally, all fixtures have been updated. * Remove reference to deleted extractor * feat: first batch of test and parser updates due to new fixtures * feat: update more custom parsers and unit tests * feat: update more custom parsers and unit tests and remove unnecessary parser * feat: update more custom parsers and unit tests * feat: update more parsers and add correct bloomberg html files * fix: remove console statement * feat: all parsers updated and tests passing * fix: update date_published tests to account for test server time difference * fix: cleanup remaining fixtures in folders * feat: move fixtures for newest custom parsers * feat: remove script changes * fix: update dist files to account for reverting script changes * adding .DS_Store to .gitignore * adding .DS_Store to .gitignore -- 2 * adding .DS_Store to .gitignore -- 3 lol * cleaning up some tests * fix: ran build:generator command to update generate-custom-parser dist file * fix: update rollup configs to generate source maps and update source maps * fix: use underscore in place of unused error variable * fix: remove unused fixture Co-authored-by: Postlight Bot <[email protected]> Co-authored-by: flbn <[email protected]>
1 parent 7b68bcd commit c0364ec

File tree

547 files changed

+248724
-41727
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

547 files changed

+248724
-41727
lines changed

‎.gitignore

+1
Original file line numberDiff line numberDiff line change
@@ -13,3 +13,4 @@ tmp/artifacts
1313
test-output.json
1414
.tool-versions
1515
.yarnrc.yml
16+
**/.DS_Store

‎dist/generate-custom-parser.js

+788-397
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/generate-custom-parser.js.map

+1-1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/mercury.esm.js

+4-3
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/mercury.esm.js.map

+1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/mercury.js

+255-272
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/mercury.js.map

+1-1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/mercury.web.js

+2-1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎dist/mercury.web.js.map

+1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎fixtures/247sports.com.html

+822
Large diffs are not rendered by default.

‎fixtures/247sports.com/1481309665090.html

-1
This file was deleted.

‎fixtures/abcnews.go.com.html

+687
Large diffs are not rendered by default.

‎fixtures/abcnews.go.com/1481922563840.html

-1
This file was deleted.

‎fixtures/ars.html

-540
This file was deleted.

‎fixtures/arstechnica.com/1587927767738.html renamed to ‎fixtures/arstechnica.com.html

+133-115
Large diffs are not rendered by default.

‎fixtures/arstechnica.com/1587929444000.html

-615
This file was deleted.

‎fixtures/biorxiv.org/1565356858754.html renamed to ‎fixtures/biorxiv.org.html

File renamed without changes.

‎fixtures/blisterreview.com.html

+1,530
Large diffs are not rendered by default.

‎fixtures/blisterreview.com/1551128228532.html

-1,009
This file was deleted.

‎fixtures/bookwalker.jp.html

+1,035
Large diffs are not rendered by default.

‎fixtures/bookwalker.jp/1554821842273.html

-913
This file was deleted.

‎fixtures/buzzap.jp/1551497136221.html renamed to ‎fixtures/buzzap.jp.html

File renamed without changes.

‎fixtures/clinicaltrials.gov.html

+1,262
Large diffs are not rendered by default.

‎fixtures/clinicaltrials.gov/1551708504719.html

-1,302
This file was deleted.

‎fixtures/deadline.com/1556104756617.html renamed to ‎fixtures/deadline.com.html

+1,392-993
Large diffs are not rendered by default.

‎fixtures/deadspin.com--video.html

+39
Large diffs are not rendered by default.

‎fixtures/deadspin.com.html

+39
Large diffs are not rendered by default.

‎fixtures/deadspin.com/1476389931786.html

-1
This file was deleted.

‎fixtures/deadspin.com/1477505848605.html

-1
This file was deleted.

‎fixtures/epaper.zeit.de/1566927390034.html renamed to ‎fixtures/epaper.zeit.de.html

+2-2
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
<div class="container">
1212
<div class="row">
1313
<div class="col-xs-12">
14-
14+
1515
<div class="article">
1616
<div class="article__author">
1717
Politik &#xB7; Jochen Bittner, Tina Hildebrandt </div>
@@ -28,4 +28,4 @@
2828
</div>
2929
</div>
3030
</body>
31-
</html>
31+
</html>

‎fixtures/fandom.wikia.com/1475595373938.html renamed to ‎fixtures/fandom.wikia.com.html

File renamed without changes.

‎fixtures/fortune.com/1485216994169.html renamed to ‎fixtures/fortune.com.html

File renamed without changes.

‎fixtures/forward.com.html

+858
Large diffs are not rendered by default.

‎fixtures/forward.com/1488392273490.html

-602
This file was deleted.

‎fixtures/fusion.net/1482529202024.html

-1
This file was deleted.

‎fixtures/genius.com/1550609084053.html renamed to ‎fixtures/genius.com.html

File renamed without changes.

‎fixtures/getnews.jp.html

+609
Large diffs are not rendered by default.

‎fixtures/getnews.jp/1555846693544.html

-437
This file was deleted.

‎fixtures/github.com.html

+3,025
Large diffs are not rendered by default.

‎fixtures/github.com/1551742565097.html

-822
This file was deleted.

‎fixtures/gothamist.com.html

+1,060
Large diffs are not rendered by default.

‎fixtures/gothamist.com/1489073770258.html

-442
This file was deleted.

‎fixtures/hellogiggles.com.html

+1,613
Large diffs are not rendered by default.

‎fixtures/hellogiggles.com/1482437663500.html

-234
This file was deleted.

‎fixtures/ici.radio-canada.ca.html

+57
Large diffs are not rendered by default.

‎fixtures/ici.radio-canada.ca/1489433621634.html

-1,530
This file was deleted.

‎fixtures/japan.cnet.com.html

+948
Large diffs are not rendered by default.

‎fixtures/japan.cnet.com/1555118717655.html

-961
This file was deleted.

‎fixtures/japan.zdnet.com/1556591023244.html renamed to ‎fixtures/japan.zdnet.com.html

File renamed without changes.

‎fixtures/jvndb.jvn.jp.html

+236
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,236 @@
1+
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="ja" lang="ja" style="overflow-x:hidden" class=""><head>
2+
<meta http-equiv="Content-Type" content="text/html; charset=Shift_JIS">
3+
<title>JVNDB-2018-013542 - JVN iPedia - 脆弱性対策情報データベース</title>
4+
5+
<meta name="Keywords" content="脆弱性対策情報データベース">
6+
<meta name="Description" content="脆弱性対策情報データベース">
7+
<meta http-equiv="X-UA-Compatible" content="IE=edge, requiresActiveX=true">
8+
<meta http-equiv="Content-Script-Type" content="text/javascript">
9+
<meta http-equiv="Content-Style-Type" content="text/css">
10+
11+
<link href="/common/css/master.css" rel="stylesheet" type="text/css" media="screen,print">
12+
<link media="all" href="/common/css/provide.css" type="text/css" rel="stylesheet">
13+
<link href="/common/css/font.css" rel="stylesheet" type="text/css" media="screen,print">
14+
<link href="/common/css/print.css" rel="stylesheet" type="text/css" media="print">
15+
<link href="/common/css/rightmenu.css" rel="stylesheet" type="text/css" media="screen,print">
16+
17+
<link type="text/css" rel="stylesheet" charset="UTF-8" href="https://translate.googleapis.com/translate_static/css/translateelement.css"></head>
18+
<body>
19+
<a name="top" id="top"></a>
20+
<!-- ↓ ヘッダ表示 ↓ -->
21+
<div id="wrapper">
22+
23+
<!-- header begin -->
24+
<div id="header">
25+
<div class="logo"><a href="/"><img height="60" alt="JVN iPedia - 脆弱性対策情報データベース" src="/common/img/logo.gif" width="490" border="0"></a></div>
26+
<div class="modifytxt">最終更新日：2019/02/22</div>
27+
<div class="modifytxt"></div>
28+
</div>
29+
<div id="head-bar">
30+
<a href="/nav/guide_sysadm.html">【活用ガイド】</a>
31+
</div>
32+
<!-- header end -->
33+
34+
<!-- mainarea begin -->
35+
<div id="mainarea">
36+
<!-- leftarea begin -->
37+
<div id="leftarea">
38+
<div class="contents">
39+
<div id="news-list">
40+
<br>
41+
<table class="vuln_table_clase">
42+
43+
<tbody><tr><td colspan="2">
44+
<h2><font face="arial, geneva, helvetica">JVNDB-2018-013542</font></h2>
45+
</td></tr>
46+
47+
<tr><td colspan="2">
48+
<h2>NETWAVE&nbsp;MNG6200&nbsp;デバイスにおける証明書・パスワードの管理に関する脆弱性</h2>
49+
</td></tr>
50+
51+
<tr><td class="vuln_table_clase_td_header" colspan="2">
52+
<a name="overview">概要</a>
53+
</td></tr>
54+
<tr><td colspan="2">
55+
<br>
56+
<blockquote>
57+
NETWAVE MNG6200 デバイスには、証明書・パスワードの管理に関する脆弱性が存在します。
58+
</blockquote>
59+
</td></tr>
60+
<tr><td class="vuln_table_clase_td_header" colspan="2">
61+
<a name="cvss">CVSS による深刻度</a> (<a href="/nav/jvndbhelp.html#jvndb3" target="_blank">CVSS とは?</a>)
62+
</td></tr>
63+
<tr><td colspan="2">
64+
<br>
65+
<div style="margin: 20px 40px;">
66+
<div class="clearfix">
67+
<div class="float_left">
68+
<b>CVSS v3 による深刻度<br>基本値: <a href="/cvss/ja/v3.html#CVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:H/I:H/A:H" target="_blank">9.8</a> (緊急) [NVD値]</b>
69+
<ul>
70+
<li>攻撃元区分: ネットワーク</li>
71+
<li>攻撃条件の複雑さ: 低</li>
72+
<li>攻撃に必要な特権レベル: 不要</li>
73+
<li>利用者の関与: 不要</li>
74+
<li>影響の想定範囲: 変更なし</li>
75+
<li>機密性への影響(C): 高</li>
76+
<li>完全性への影響(I): 高</li>
77+
<li>可用性への影響(A): 高</li>
78+
</ul>
79+
</div>
80+
<div class="float_left">
81+
<b>CVSS v2 による深刻度<br>基本値: <a href="/cvss/ja/v2.html#AV:N/AC:L/Au:N/C:P/I:N/A:N" target="_blank">5.0</a> (警告) [NVD値]</b>
82+
<ul>
83+
<li>攻撃元区分: ネットワーク</li>
84+
<li>攻撃条件の複雑さ: 低</li>
85+
<li>攻撃前の認証要否: 不要</li>
86+
<li>機密性への影響(C): 部分的</li>
87+
<li>完全性への影響(I): なし</li>
88+
<li>可用性への影響(A): なし</li>
89+
</ul>
90+
</div>
91+
</div>
92+
<div style="margin-top:20px">
93+
94+
</div>
95+
</div>
96+
</td></tr>
97+
98+
<tr><td class="vuln_table_clase_td_header" colspan="2">
99+
<a name="affect">影響を受けるシステム</a>
100+
</td></tr>
101+
102+
<tr><td colspan="2">
103+
<br>
104+
<blockquote>
105+
106+
</blockquote>
107+
</td></tr>
108+
109+
<tr><td colspan="2">
110+
<br>
111+
<blockquote>
112+
NETWAVE&nbsp;Networks,&nbsp;Inc.
113+
<ul>
114+
<li>MNG6200&nbsp;ファームウェア C4835805jrc12FU121413.cpr</li>
115+
</ul>
116+
</blockquote>
117+
</td></tr>
118+
119+
<tr><td colspan="2">
120+
<br>
121+
<blockquote>
122+
123+
</blockquote>
124+
</td></tr>
125+
126+
<tr><td class="vuln_table_clase_td_header" colspan="2">
127+
<a name="impact">想定される影響</a>
128+
</td></tr>
129+
130+
<tr><td colspan="2">
131+
<br>
132+
<blockquote>
133+
情報を取得される、情報を改ざんされる、およびサービス運用妨害 (DoS) 状態にされる可能性があります。
134+
</blockquote>
135+
</td></tr>
136+
137+
<tr><td class="vuln_table_clase_td_header" colspan="2">
138+
<a name="solution">対策</a>
139+
</td></tr>
140+
141+
<tr><td colspan="2">
142+
<br>
143+
<blockquote>
144+
参考情報を参照して適切な対策を実施してください。
145+
</blockquote>
146+
</td></tr>
147+
148+
<tr><td class="vuln_table_clase_td_header" colspan="2">
149+
<a name="venderinf">ベンダ情報</a>
150+
</td></tr>
151+
152+
<tr><td colspan="2">
153+
<br>
154+
<blockquote>
155+
</blockquote>
156+
</td></tr>
157+
158+
159+
<tr><td class="vuln_table_clase_td_header" colspan="2">
160+
<a name="cwe">CWEによる脆弱性タイプ一覧</a>&nbsp;&nbsp;<a href="http://www.ipa.go.jp/security/vuln/CWE.html" target="_blank">CWEとは?</a>
161+
</td></tr>
162+
163+
164+
<tr><td colspan="2">
165+
<br>
166+
<blockquote>
167+
<ol>
168+
<li><a href="https://jvndb.jvn.jp/ja/cwe/CWE-255.html" target="_blank">証明書・パスワードの管理(CWE-255)</a> [NVD評価]</li>
169+
</ol>
170+
</blockquote>
171+
</td></tr>
172+
173+
174+
<tr><td class="vuln_table_clase_td_header" colspan="2">
175+
<a name="cve">共通脆弱性識別子(CVE)</a>&nbsp;&nbsp;<a href="http://www.ipa.go.jp/security/vuln/CVE.html" target="_blank">CVEとは?</a>
176+
</td></tr>
177+
178+
<tr><td colspan="2">
179+
<br>
180+
<blockquote>
181+
<ol>
182+
<li><a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2018-20395" target="_blank">CVE-2018-20395</a></li>
183+
</ol>
184+
</blockquote>
185+
</td></tr>
186+
187+
188+
<tr><td class="vuln_table_clase_td_header" colspan="2">
189+
<a name="reference">参考情報</a>
190+
</td></tr>
191+
192+
<tr><td colspan="2">
193+
<br>
194+
<blockquote>
195+
<ol>
196+
<li>National&nbsp;Vulnerability&nbsp;Database&nbsp;(NVD) : <a href="https://nvd.nist.gov/vuln/detail/CVE-2018-20395" target="_blank">CVE-2018-20395</a> </li>
197+
<li>関連文書 : <a href="https://github.com/ezelf/sensitivesOids/blob/master/oidpassswordleaks.csv" target="_blank">sensitivesOids/oidpassswordleaks.csv</a> </li>
198+
</ol>
199+
</blockquote>
200+
</td></tr>
201+
202+
<tr><td class="vuln_table_clase_td_header" colspan="2">
203+
<a name="history">更新履歴</a>
204+
</td></tr>
205+
<tr><td colspan="2">
206+
<br>
207+
<blockquote>
208+
<ul style="list-style-type: none">
209+
<li>[2019年02月22日]<br>
210+
&nbsp;&nbsp;掲載</li>
211+
</ul>
212+
</blockquote>
213+
<br>
214+
</td></tr>
215+
</tbody></table>
216+
<table class="vuln_table_clase_footer">
217+
<tbody><tr><td colspan="2"><hr></td></tr>
218+
<tr><td class="vuln_table_clase_date_header_td">公表日</td><td>2018/12/23</td></tr>
219+
<tr><td class="vuln_table_clase_date_header_td">登録日</td><td>2019/02/22</td></tr>
220+
<tr><td class="vuln_table_clase_date_header_td">最終更新日</td><td>2019/02/22</td></tr>
221+
<tr><td colspan="2"><hr></td></tr>
222+
</tbody></table>
223+
<!--
224+
</td></tr></table>
225+
</body>
226+
</html>
227+
--> </div>
228+
</div>
229+
</div>
230+
</div>
231+
<div id="footer">
232+
<div class="footertext"><img src="/common/img/copyright.png" alt="Copyright © 2007- IPA. All rights reserved."></div>
233+
</div>
234+
</div><div id="goog-gt-tt" class="skiptranslate" dir="ltr"><div style="padding: 8px;"><div><div class="logo"><img src="https://www.gstatic.com/images/branding/product/1x/translate_24dp.png" width="20" height="20" alt="Google Translate"></div></div></div><div class="top" style="padding: 8px; float: left; width: 100%;"><h1 class="title gray">Original text</h1></div><div class="middle" style="padding: 8px;"><div class="original-text"></div></div><div class="bottom" style="padding: 8px;"><div class="activity-links"><span class="activity-link">Contribute a better translation</span><span class="activity-link"></span></div><div class="started-activity-container"><hr style="color: #CCC; background-color: #CCC; height: 1px; border: none;"><div class="activity-root"></div></div></div><div class="status-message" style="display: none;"></div></div>
235+
236+
<div class="goog-te-spinner-pos"><div class="goog-te-spinner-animation"><svg xmlns="http://www.w3.org/2000/svg" class="goog-te-spinner" width="96px" height="96px" viewBox="0 0 66 66"><circle class="goog-te-spinner-path" fill="none" stroke-width="6" stroke-linecap="round" cx="33" cy="33" r="30"></circle></svg></div></div></body></html>

0 commit comments

Comments
 (0)