Issue with resolving dependencies while building a product with Tycho 4

[travkin79]

Hello @laeubi,
I prepared an OSS repo with my project where I have some challenges resolving dependencies with Tycho 4 when materializing a product.

Setup

• I have a target definition file that I use to collect all required bundles and specify their min. versions.
• I'm using includeAllPlatforms="false" and includeMode="planner"
• I have <unit id="org.apache.felix.scr" version="2.2.12"/> in my target definition

Though, the p2 director goal materialize-products complains about a missing felix.scr dependency (see logs in GitHub workflow build). 🤔

[ERROR] Failed to execute goal org.eclipse.tycho:tycho-p2-director-plugin:4.0.13:materialize-products (materialize-products) on project ...
... for environment linux/gtk/x86_64 failed: ...
Missing requirement: toolinggtk.linux.x86_64org.apache.felix.scr 1.5.4.20250724-1111 requires 'osgi.bundle; org.apache.felix.scr 0.0.0' but it could not be found...

I'm on Windows at the moment, the CI build is on MacOS. I try to build for Linux, MacOS, and Windows. I use tycho 4.0.13. Am I doing something wrong?

Is there an easier way to collect all necessary dependencies for a product? I thought, tycho would do most of the necessary steps automatically by transitively following the plug-ins dependencies.

Is there something wrong with my product configuration?

Any help is very appreciated. Thank you and best regards.
Dietrich

[travkin79]

Hi @laeubi,
I tried so many things now. Nothing works. I begin to think, there might be a tycho bug.

I tried switching to includeAllPlatforms="true" and includeMode="slicer" in the target platform definition, since that worked well for me in another project. But after adding numerous dependencies I still get the same or similar error messages. For some reason, the error messages sometimes differ without any code change. But the messages alway say, tycho would not find one of the following OSGi bundles:

• org.apache.felix.scr
• org.eclipse.equinox.simpleconfigurator
• org.eclipse.equinox.event

Interestingly, these are exactly the bundles listed in the product's start level configuration. I added all of them to the target platform definition, but Tycho still doesn't find them. I tried it on Windows as well as on MacOS on my machines and with GitHub workflows using MacOS, I always get the same error messages.

I also saw some suspicious warnings like the following. But it seems unrelated to not resolving the bundles.

Warning:  Parameter 'useJdk' is unknown for plugin 'tycho-compiler-plugin:4.0.13:compile (default-compile)'

Do you have any idea how I could let tycho resolve the dependencies and materialize the product?

[laeubi]

@travkin79 sadly one can not build the provided project I always get:

[ERROR] Failed to execute goal on project net.certiv.fluentmark.core: Could not resolve dependencies for project net.certiv.fluentmark:net.certiv.fluentmark.core:eclipse-plugin:1.5.4-SNAPSHOT
[ERROR] dependency: com.advantest.markdown:markdown-core:jar:1.0.7-SNAPSHOT (compile)
[ERROR] 	Could not transfer artifact com.advantest.markdown:markdown-core:jar:1.0.7-SNAPSHOT from/to github-packages-flexmark (https://maven.pkg.github.com/advantest/flexmark-java): status code: 401, reason phrase: Unauthorized (401)
[ERROR] 	Could not transfer artifact com.advantest.markdown:markdown-core:jar:1.0.7-SNAPSHOT from/to github-packages-markdown-core (https://maven.pkg.github.com/advantest/markdown-core): status code: 401, reason phrase: Unauthorized (401)
[ERROR] 
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command

Could you probably adjust the project so it only uses public source?

As there are numerous projects building Tycho projects without a problem its likely a configuration issue, so I would try to reduce the example much more.

Looking the the product itself it currently only includes one bundle

   <plugins>
      <plugin id="com.advantest.fluentmark.cli"/>
   </plugins>

if that bundle do not itself has requirements to all the mentioned bundles it will simply not be resolved.
So either you need to list more bundles (at least the ones here:

   <configurations>
      <plugin id="org.apache.felix.scr" autoStart="true" startLevel="2" />
      <plugin id="org.eclipse.core.runtime" autoStart="true" startLevel="4" />
      <plugin id="org.eclipse.equinox.common" autoStart="true" startLevel="2" />
      <plugin id="org.eclipse.equinox.event" autoStart="true" startLevel="2" />
      <plugin id="org.eclipse.equinox.simpleconfigurator" autoStart="true" startLevel="1" />
   </configurations>

or better use a feature (e.g. in mixed mode) that include the basics.

[travkin79]

Hi @laeubi,
Thank you for looking into this.
In fact, the dependencies are all public, but not all resolvable via Maven Central. Two bundles or only on GitHub Packages. The GitHub workflows are able to resolve these dependencies, but for some reason that cannot be done if you you build the code locally. A work-around would be to download them from GitHub packages or clone the two projects and build them locally (mvn install). This is how I build the project on my machine.

Here are the two relevant git repos with the dependencies that cannot easily be resolved locally, in case you'd like to give it a try. Each of them needs to be in develop branch.

• https://github.com/advantest/flexmark-java/tree/develop
• https://github.com/advantest/markdown-core/tree/develop

I'll try adding the bundles you mentioned to the CLI bundle's dependencies.

[laeubi]

I'll try adding the bundles you mentioned to the CLI bundle's dependencies.

dont add them as dependencies please!! Add them to the product!

[travkin79]

Ah, thank you. That makes more sense, of course. Done.

[merks]

Yes I tried to help too but gave up when I hit that same problem that I can’t fix.

Here’s a very simple project that builds a product

https://github.com/eclipse-cbi/p2repo-sbom

Maybe that helps?

[travkin79]

Thank you both, @laeubi and @merks,
Now it works. @laeubi, you gave me the right hint to add the above mentioned bundles to the main plug-in's dependencies. That change has fixed it.

I thought, it's enough to declare the "usual" dependencies in the application's manifest and let the product configure how it is started and Tycho would automatically add org.apache.felix.scr and similar bundles to the materialized product. But it seems, the product must include org.apache.felix.scr and other similar bundles from the product's start level config in it the product's contents, i.e. the plug-ins and features that represent the product.

[travkin79]

Do you also have an idea why I get these warnings? There must be something wrong, but I have no clue.

Warning:  Parameter 'useJdk' is unknown for plugin 'tycho-compiler-plugin:4.0.13:compile (default-compile)'

[laeubi]

It is what it says, you are using a parameter that is not there. So search your pom.xml for that and likely just remove it.

You can also aim for a pomless configuration what removes the need for most of the hassle:
https://tycho.eclipseprojects.io/doc/latest/StructuredBuild.html

[travkin79]

I found the reason myself by comparing my code with that of Ed, Thank you @merks. It has to be "useJDK", not "useJdk". 😄

[travkin79]

Yes, a pom-less build will be one of the next improvements.

[laeubi]

Just a hint useJDK is mostly useless these days ... I would not use it for any new project design.

[travkin79]

Thank you. I'm already using the maven enforcer plug-in to enforce the required Java and Maven versions anyway. So there seems to be no need for useJDK.