Linking issue - static libs

[mllouay]

I'm using very recent aws-sdk-cpp 1.11.471 with my program running on Linux enviornment.

I was able to compile the aws-sdk-cpp and get the libraries with the following:
mkdir build && cd build
cmake3 .. -DCMAKE_BUILD_TYPE=Debug -DBUILD_ONLY="core;s3;transfer" -DBUILD_SHARED_LIBS=Off
cmake --build .

Note: I don't need to install it. So i don't need the -DCMAKE_PREFIX_PAT -DCMAKE_INSTALL_PREFIX options, or the 'make install'. I just want the static libraries to use in my program.

When I link and try to compile with my program, I get AWS libs linking issues, 'undefined behavior' of AWS SDK variables. I'm linking the AWS SDK libraries in this order:
aws-crt-cpp
aws-cpp-sdk-core
aws-cpp-sdk-s3
aws-cpp-sdk-transfer
aws-c-event-stream
aws-checksums
aws-c-mqtt
aws-c-http
aws-c-compression
aws-c-s3
aws-c-auth
aws-c-cal
aws-c-io
aws-c-common
s2n
aws-c-sdkutils

I think these are inter dependencies among the AWS SDK libraries. Most likely it's the order of AWS libraries have to be in due to their dependencies during linking. I tried many different orders but no luck.
I'm not sure the order they should be? I'm not sure which libraries I'm missing? if any.

Some of the undefined reference linking errors i'm getting are:
undefined reference to aws_cbor_decoder_get_remaining_length' undefined reference to aws_cbor_decoder_consume_next_whole_data_item'
undefined reference to aws_condition_variable_wait_pred' undefined reference to aws_crt_statistics_tls_reset'
undefined reference to aws_crt_statistics_socket_reset' undefined reference to aws_cbor_encoder_get_encoded_data'
undefined reference to aws_cbor_encoder_write_text' undefined reference to aws_cbor_encoder_write_uint'
undefined reference to aws_cbor_decoder_new' undefined reference to aws_cbor_decoder_destroy'
undefined reference to aws_hex_encode_append_dynamic' undefined reference to aws_cbor_decoder_pop_next_bytes_val'
undefined reference to aws_host_resolver_get_host_address_count' undefined reference to aws_cbor_decoder_pop_next_boolean_val'
undefined reference to aws_is_any_directory_separator' undefined reference to aws_cbor_encoder_write_break'
ndefined reference to aws_backtrace_print' undefined reference to aws_host_resolver_record_connection_failure'
undefined reference to aws_cbor_encoder_write_indef_array_start' undefined reference to aws_host_resolver_new_default'
undefined reference to aws_utf8_decoder_finalize' undefined reference to aws_cbor_decoder_pop_next_tag_val'
undefined reference to aws_crt_statistics_http1_channel_init' undefined reference to aws_common_library_init'
undefined reference to aws_cbor_encoder_write_indef_map_start' undefined reference to aws_utf8_decoder_update'
undefined reference to g_set_mempolicy_ptr' undefined reference to pthread_atfork'
undefined reference to aws_cbor_decoder_pop_next_text_val' undefined reference to aws_utf8_decoder_destroy'
undefined reference to s2n_crypto_free' undefined reference to aws_cbor_encoder_write_array_start'
undefined reference to aws_get_platform_build_os' undefined reference to aws_cbor_decoder_pop_next_unsigned_int_val'
undefined reference to aws_normalize_directory_separator' undefined reference to aws_backtrace_symbols'
undefined reference to aws_base64_compute_decoded_len' undefined reference to aws_crt_statistics_http1_channel_reset'
undefined reference to aws_cbor_decoder_peek_type' undefined reference to aws_cbor_encoder_write_indef_bytes_start'
undefined reference to aws_base64_compute_encoded_len' undefined reference to aws_backtrace'
undefined reference to aws_system_environment_load_platform_impl' undefined reference to aws_cbor_encoder_write_map_start'
undefined reference to `aws_host_resolver_init_default_resolution_config'
...

[sbiscigl]

Note: I don't need to install it. So i don't need the -DCMAKE_PREFIX_PAT -DCMAKE_INSTALL_PREFIX options, or the 'make install'. I just want the static libraries to use in my program.

so this kind of jumps out at me, how are you trying to consume the SDK? why dont you want to install it? how are you consuming the SDK in your project/building your project? cmake?

[mllouay]

Currently we have a much older version of AWS SDK that I'm are updating to the latest AWS SDK. We use the AWS SDK static libraries, build and link them (make). For example, the older 1.8.186 AWS SDK version, I used the following to get the AWS static libraries, and build/compiled/linked them with our program:
cmake3 .. -DCMAKE_BUILD_TYPE=Release -DBUILD_ONLY="core;s3;transfer" -DBUILD_SHARED_LIBS=OFF -DENABLE_UNITY_BUILD=ON -DCMAKE_CXX_FLAGS="-fPIC -Wno-deprecated-copy -Wno-noexcept-type -Wno-maybe-uninitialized -Wno-range-loop-construct -Wno-deprecated-declarations -Wno-unused-parameter -Wno-nonnull -Wno-uninitialized"

In the AWS SDK v1.8.186 these libraries, were linked in this order and build with our program:
aws-cpp-sdk-core aws-cpp-sdk-s3 aws-cpp-sdk-transfer aws-c-event-stream aws-checksums aws-c-common

With updating to the latest AWS SDK v1.11.471, building AWS SDK as described above, gives these static libraries
aws-crt-cpp
aws-cpp-sdk-core
aws-cpp-sdk-s3
aws-cpp-sdk-transfer
aws-c-event-stream
aws-checksums
aws-c-mqtt
aws-c-http
aws-c-compression
aws-c-s3
aws-c-auth
aws-c-cal
aws-c-io
aws-c-common
s2n
aws-c-sdkutils

But I'm getting undefined references when building with our program, at the 'linking', as shown above (Undefined references).

That's what I need help with, the ordering of libraries? These have dependencies among each other, have to be in right order to be able to link. Maybe I'm missing other AWS SDK libraries? Maybe any additional parameters to the cmake command line above? Any other suggestions would be appreciated?

[j2inet]

Were you able to get a resolution on this? I'm trying to build the latest version of the SDK and I'm running into the same problem.

[mllouay]

Were you able to get a resolution on this? I'm trying to build the latest version of the SDK and I'm running into the same problem.

No, no one responded to me :(
I tried many different things to try to get it to compile, including latest version of the SDK, but no luck. Same undefined reference errors.

[mllouay]

We would appreciate any help, thanks

[j2inet]

I've made a thread asking about a facet of the issue using the absolute minimal well-formed AWS CPP program that I can write. I'd suggest subscribing to the question. In either case, if the answer that I get (🤞) and if it appears relevant here, then I'll try to remember to post back here.

#3356

[DmitriyMusatkin]

cpp base depends on crt-cpp, which depends on a bunch of c-*. you can use the ordering in readme here if you really want to statically link everything - https://github.com/awslabs/aws-c-s3

[j2inet]

As things often goes, I just found this out through some experimentation over the last error. If I had just read your post an hour ago I would have acquired this knowledge with much less effort! I'm about to post the details in the other thread that I made. I was documenting my methods as I went along. May as well post it somewhere and not feel like I totally wasted my time! (I probably did, but let's pretend I didn't).

[j2inet]

@mllouay - It is working for me. Could you take a look at #3356 and let me know whether that resolves things for you? If they don't, could you let me know what errors you continue to see?