Skip to content

GPU Support for tensorflow lite #1532

Open
barrypitman wants to merge 28 commits intobytedeco:masterfrom
barrypitman:v1.5.10-GPU
Open

GPU Support for tensorflow lite #1532
barrypitman wants to merge 28 commits intobytedeco:masterfrom
barrypitman:v1.5.10-GPU

Conversation

@barrypitman
Copy link
Contributor

@barrypitman barrypitman commented Aug 20, 2024

This PR includes some changes to enable building tensorflow-lite with -DTFLITE_ENABLE_GPU=ON for linux x64-64.

There are still some outstanding issues though:

  • for linux-x86_64 (-gpu), its building the jar file, but then failing during staging / deploy based on the tensorflow-lite/platform/gpu/pom.xml that I provided.
  • for android it's failing because of TfLiteGpuDelegateV2CreateAsync
  • for windows I think that the target functions aren't available since tflite doesn't support GPU on Windows, but I'm not sure how to conditionally exclude them

@barrypitman
try build GPU version of tflite for linux x86_64
6783eb2
@barrypitman
fix extension '-gpu' and not 'gpu'
90090a9
@barrypitman
attach the installed artifacts
a770534
@barrypitman
trigger tflite build
5f9b5f2
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
dac6dc9
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
ca050e8
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
7f72a1b
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
da830fc
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
b49f365
@barrypitman
trigger rebuild
06608c0
@barrypitman
provide different names for artifacts
000b538
@barrypitman
try to generate GPU delegate
b247282
@barrypitman
try to generate GPU delegate
0816ed0
@barrypitman
add missing delegate_options
95590cc
@barrypitman
add other header files for gpu extension
11023db
@barrypitman
try suggestions from bytedeco#1529 (comment)
2de3669
@barrypitman
remove the exclusion of android
ff22226
@barrypitman
define #if defined(__ANDROID__)
5e0d80e
@barrypitman
copy approach from tensorflow (full)
8bc91df
@barrypitman
don't define TfLiteGpuDelegateV2CreateAsync
e12b7b3
@barrypitman
skip based on linePatterns
af595d4
@barrypitman
Merge branch 'master' of github.com:barrypitman/javacpp-presets into …
f45c2bb 
…v1.5.10-GPU

# Conflicts:
#	tensorflow-lite/src/main/java/org/bytedeco/tensorflowlite/presets/tensorflowlite.java
@barrypitman
sync with main
4aaa421
@barrypitman
sync with main
a0c311d
@barrypitman
gpu_invoke_loop_times
7fef1bc
@barrypitman
cleanup
c369391
@barrypitman
define TfLiteGpuDelegateV2CreateAsync function for android
13c95d5
@barrypitman
define TfLiteGpuDelegateV2CreateAsync function for android
5890823
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

enhancement help wanted

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@barrypitman @saudet