Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
d7c02fc
WIP: early chargeback code for review
JohannesMahne Jun 26, 2025
d796e7e
Working config integration - 0.0.2
JohannesMahne Jun 27, 2025
f3d302b
Version 0.0.3: working from Stack monitoring data
JohannesMahne Jun 30, 2025
cdf1506
Fixed query for one visualisation
JohannesMahne Jun 30, 2025
0ca1574
Update instructions
JohannesMahne Jun 30, 2025
a689f68
Working with the correct alias
JohannesMahne Jun 30, 2025
2fabafc
Changes to transforms
JohannesMahne Jul 3, 2025
23ac225
Bug fix: Fix sorting on visualisation.
JohannesMahne Jul 3, 2025
7d92797
Update setup instructions
JohannesMahne Jul 3, 2025
ddc3b42
0.1.0: Adding ECU value (normalised cost).
JohannesMahne Jul 3, 2025
c7fade7
Bug: Aligned fields returned to field names used in visualisation
JohannesMahne Jul 15, 2025
c01342e
Fixing bug: aligning esql returned field names with field names used …
JohannesMahne Jul 15, 2025
0495d1a
move to packages
sholzhauer-es Jul 15, 2025
139567f
not starting transforms on integration installation
sholzhauer-es Jul 15, 2025
7cdccb4
Update version number
JohannesMahne Jul 15, 2025
721c949
Made sure the colour palette is predictable by using the eui_amsterda…
JohannesMahne Jul 16, 2025
2487bc2
Update sequence and comments on pre-setup to promote ES integration
JohannesMahne Jul 16, 2025
97485ad
Consistent naming of datastream. Add LIMIT 5000 to ESQL top query to …
JohannesMahne Jul 17, 2025
aa1ecec
Add correct code owner
JohannesMahne Jul 17, 2025
2e983f0
Delete wrong test files
JohannesMahne Jul 17, 2025
119602c
Updated the directory structure to remove superfluous directory
JohannesMahne Jul 22, 2025
efccd92
Rem reference to sample logs and logos
JohannesMahne Jul 22, 2025
d6737f2
Switch off dynamic mappings for the results of the transforms - we kn…
JohannesMahne Jul 22, 2025
c10cab2
Removed agent folders in data stream, as it is not used.
JohannesMahne Jul 22, 2025
9787c18
Updated the readme file to refer to integration, rather than module. …
JohannesMahne Jul 22, 2025
82a215f
Re-add image
JohannesMahne Jul 22, 2025
71e7c10
Formatting
JohannesMahne Jul 22, 2025
e0995d2
Merge branch 'main' into johannes-chargeback-wip
JohannesMahne Jul 24, 2025
e9d69d9
NOT WORKING: settings index.mode: lookup is not supported
JohannesMahne Jul 24, 2025
ccc2868
Fixing the control error in the dashboard by adding a data view.
JohannesMahne Aug 4, 2025
fedc112
Updated to push back usage data transform to ES Integration
JohannesMahne Aug 6, 2025
c51903f
Updated readme
JohannesMahne Aug 6, 2025
5eebcda
Update transfrom version numbers
JohannesMahne Aug 6, 2025
cc7edc4
Swap the use of deployment_id or deployment name to a concatenation o…
JohannesMahne Aug 8, 2025
c766a22
Merge branch 'chargeback-db-change' into johannes-chargeback-wip
JohannesMahne Aug 8, 2025
6ef4bdc
Make use of the new elastic-package version, which will create the lo…
JohannesMahne Sep 23, 2025
97809ab
Merge remote-tracking branch 'origin/main' into johannes-chargeback-wip
JohannesMahne Sep 23, 2025
2171907
Update version number
JohannesMahne Sep 23, 2025
f742d09
Updated pre-setup, and version number
JohannesMahne Sep 23, 2025
9f7105c
Adding casting to double for division to avoid null instead of very s…
JohannesMahne Nov 6, 2025
35e216f
Update version
JohannesMahne Nov 6, 2025
abc348d
Allowing for setting converion rate per time window
sholzhauer-es Nov 24, 2025
671ee23
fixing pipeline versions
sholzhauer-es Nov 24, 2025
bed70c8
adding pipeline stuff
sholzhauer-es Nov 25, 2025
e5ef8f7
correcting version
sholzhauer-es Nov 25, 2025
3311c2d
[Chargeback] Dashboard control and Dataview (#16153)
sholzhauer-es Dec 1, 2025
553f0af
adding sku and cost_type to billing data for node granularity
sholzhauer-es Dec 1, 2025
f731eca
working on sku with pipeline to do parsing
sholzhauer-es Dec 1, 2025
c31e8f0
downplaying version
sholzhauer-es Dec 1, 2025
36e835c
transform
sholzhauer-es Dec 1, 2025
5f1bc00
SKU based chargeback (#16182)
sholzhauer-es Dec 2, 2025
db583ad
Chargeback Integration: Extract deployment group from Billing tags (#…
JohannesMahne Dec 2, 2025
7abcb59
merge
sholzhauer-es Dec 2, 2025
463acda
Merge branch 'johannes-chargeback-wip' into sku_based_chargeback
sholzhauer-es Dec 2, 2025
ae72452
dashboard
sholzhauer-es Dec 2, 2025
a279c53
setting version
sholzhauer-es Dec 2, 2025
0a106a3
Merge branch 'johannes-chargeback-wip' of github.com:elastic/integrat…
sholzhauer-es Dec 2, 2025
0ba83f3
Merge branch 'johannes-chargeback-wip' into sku_based_chargeback
sholzhauer-es Dec 2, 2025
41c7c49
aliging tier with cost_type
sholzhauer-es Dec 2, 2025
2f6c7cf
setting tier to include "data"
sholzhauer-es Dec 3, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 0 additions & 3 deletions packages/chargeback/_dev/build/build.yml

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -25,14 +25,20 @@ pivot:
lang: painless
source: >
if (doc.containsKey('elasticsearch.index.tier') && !doc['elasticsearch.index.tier'].empty) {
def itier = doc.containsKey('elasticsearch.index.tier') && !doc['elasticsearch.index.tier'].empty ? doc['elasticsearch.index.tier'].value : null;
if (itier == null) return 'unknown';
if (itier.contains('hot') || itier.contains('hot/content') || itier.contains('content')) return 'datahot/datacontent';
if (itier.contains('warm')) return 'datawarm';
if (itier.contains('cold')) return 'datacold';
if (itier.contains('frozen')) return 'datafrozen';
return doc['elasticsearch.index.tier'].value;
}
def pref = doc.containsKey('elasticsearch.index.tier_preference') && !doc['elasticsearch.index.tier_preference'].empty ? doc['elasticsearch.index.tier_preference'].value : null;
if (pref == null) return 'unknown';
if (pref.contains('data_hot') || pref.contains('data_content')) return 'hot/content';
if (pref.contains('data_warm')) return 'warm';
if (pref.contains('data_cold')) return 'cold';
if (pref.contains('data_frozen')) return 'frozen';
if (pref.contains('data_hot') || pref.contains('data_content')) return 'datahot/datacontent';
if (pref.contains('data_warm')) return 'datawarm';
if (pref.contains('data_cold')) return 'datacold';
if (pref.contains('data_frozen')) return 'datafrozen';
return 'unknown';
datastream:
terms:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -25,15 +25,21 @@ pivot:
lang: painless
source: >
if (doc.containsKey('elasticsearch.index.tier') && !doc['elasticsearch.index.tier'].empty) {
def itier = doc.containsKey('elasticsearch.index.tier') && !doc['elasticsearch.index.tier'].empty ? doc['elasticsearch.index.tier'].value : null;
if (itier == null) return 'unknown';
if (itier.contains('hot') || itier.contains('hot/content') || itier.contains('content')) return 'datahot/datacontent';
if (itier.contains('warm')) return 'datawarm';
if (itier.contains('cold')) return 'datacold';
if (itier.contains('frozen')) return 'datafrozen';
return doc['elasticsearch.index.tier'].value;
}

def pref = doc.containsKey('elasticsearch.index.tier_preference') && !doc['elasticsearch.index.tier_preference'].empty ? doc['elasticsearch.index.tier_preference'].value : null;
if (pref == null) return 'unknown';
if (pref.contains('data_hot') || pref.contains('data_content')) return 'hot/content';
if (pref.contains('data_warm')) return 'warm';
if (pref.contains('data_cold')) return 'cold';
if (pref.contains('data_frozen')) return 'frozen';
if (pref.contains('data_hot') || pref.contains('data_content')) return 'datahot/datacontent';
if (pref.contains('data_warm')) return 'datawarm';
if (pref.contains('data_cold')) return 'datacold';
if (pref.contains('data_frozen')) return 'datafrozen';
return 'unknown';
aggregations:
tier_sum_indexing_time:
Expand Down