Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for transparent typedefs #966

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

scovich
Copy link
Contributor

@scovich scovich commented May 24, 2024

Following #967, introduce /// cbindgen:transparent-typedef annotation that causes cbindgen to replace transparent structs and typedefs with their underlying type.

This allows the following:

/// cbindgen:transparent-typedef
#[repr(transparent)]
struct Foo(NonNull<i32>);

/// cbindgen:transparent-typedef
type Function = extern "C" fn(i: i32) -> i64;

type NullableFoo = Option<Foo>;
type NullableFunction = Option<Function>;

to export as

typedef i32 *NullableFoo;
typedef int64_t (*NullableFunction)(int32_t);

instead of today's output:

template<typename T = void>
struct Option;

using Foo = int32_t*;
using Function = int64_t(*)(int32_t i);

using NullableFoo = Option<Foo>;
using NullableFunction = Option<Function>;

@scovich scovich force-pushed the transparent-typedef branch from 7ce3ac0 to 8a76012 Compare August 12, 2024 17:50
@scovich scovich changed the title Prototype: transparent typedefs Add support for transparent typedefs Aug 12, 2024
@scovich scovich marked this pull request as ready for review August 12, 2024 17:55
Copy link
Collaborator

@emilio emilio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to take a closer look but over all looks reasonable.

for example.
```
#define MY_ATTRIBUTES [[nodiscard]]
```
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes seem unrelated? Seems ok, but maybe worth splitting into its own commit / PR? Or is it some sort of autoformatting i'm not aware of?

Copy link
Contributor Author

@scovich scovich Aug 12, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was just fixing broken indentation in the existing .md, so that bullets would render correctly. If you hide whitespace changes the diff disappears:
image

Happy to split it out if it's too noisy/annoying, tho.

src/bindgen/ir/ty.rs Outdated Show resolved Hide resolved
} => {
// Predict that ret+args will all be erased, but decrement the count whenever we're
// wrong. If the count drops to 0, then type erasure was a no-op after all.
let mut num_erased = 1 + args.len();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it'd be a bit clearer to do it the other way around. In fact, wouldn't it be a bit nicer to just:

let mut erased_any = false;
macro_rules! try_erase {
    ($item:tt) => {
        if let Some(erased) = eraser.erase_transparent_types(library, $item, mappings) {
            erased
        } else {
            $item.clone()
        }
    }

Then:

let ret = try_erase!(ret);
...

if erased_any {
    return Some(..);
}

Copy link
Contributor Author

@scovich scovich Aug 12, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, nice suggestion. I implemented it with a lambda instead of a macro tho.

@scovich scovich force-pushed the transparent-typedef branch from c4d5245 to 42ae2fe Compare August 14, 2024 13:06
@scovich scovich requested a review from emilio August 14, 2024 13:07
@scovich
Copy link
Contributor Author

scovich commented Aug 18, 2024

I just noticed that this PR overlaps significantly with #699, and probably fixes both #690 (NonZero) and #326 (Option)?

Copy link
Collaborator

@emilio emilio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry for the lag getting to this. I think this is a nice improvement, though I'm a bit concerned about performance tbh.

See some thoughts above.

pub struct TransparentTypeEraser {
// Remember paths we've already visited, so we don't repeat unnecessary work.
// TODO: how to handle recursive types such as `struct Foo { next: Box<Foo> }`?
known_types: HashMap<Type, Option<Type>>,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we really expect extremely long chains of transparent typedefs? Memoizing this seems over-kill without performance numbers, IMHO...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know about long chains, but I do expect frequent use (typedefs exist to eliminate repetition in typing out complex type names). Is frequent use not sufficient reason to memoize?

ty.clone()
}
};
let erased_ret = try_erase(ret);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A bit unfortunate to do all this cloning unconditionally just to ~almost always throw it away, fwiw...

// NOTE: Because `items` is actually a shared reference to `self`, we cannot take it as
// mutable. We also cannot `drain` or `take` it first, because then the items would be
// unavailable for lookup during the type erasure process. So we mutate a clone, and let the
// caller assign the result back after these shared references have died.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This also looks really expensive for big projects... I'd much rather find a way to avoid this unconditional clone of everything... That may mean rejiggering how we store the items, or at the very least changing how we do the pass.

It seems the only reason we need the library around is to do the transparent_alias stuff, correct?

If so, would it make sense to first do a pass over self.opaque_items, self.typedefs, and self.structs, in order to collect a Path -> Type map, and only pass that to erase_transparent_types?

@scovich
Copy link
Contributor Author

scovich commented Nov 7, 2024

@emilio -- thanks for pointing out the performance/memory hazards. It turns out this PR was also incomplete/incorrect in its handling of type parameters (specialization was not always correct). I made a second attempt from scratch in #1029, which should address all of these issues. PTAL?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants