[pull] master from tensorflow:master #87
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
… the .td definition. PiperOrigin-RevId: 698082807
* Add FC Op legalization and test data. * Add Select/Select_v2 Op legalization. * Mics cleanups. PiperOrigin-RevId: 698094953
PiperOrigin-RevId: 698111562
…rializing any modules. Also pulled the deserialization a little further up the stack and only do it if the input doesn't already have a full module op. PiperOrigin-RevId: 698116466
PiperOrigin-RevId: 698121993
PiperOrigin-RevId: 698132925
PiperOrigin-RevId: 698133024
… Todo (resolved) PiperOrigin-RevId: 698133747
This is to fix issue with gsutil which expects Python 3.5-3.11: ``` Error: gsutil requires Python version 2.7 or 3.5-3.11, but a different version is installed. ``` PiperOrigin-RevId: 698134102
PiperOrigin-RevId: 698137647
PiperOrigin-RevId: 698150097
PiperOrigin-RevId: 698163185
…. This Extend() call would also lead to a memory assignment issue since it wasn't accompanied by the necessary chunk commit requests. We also add a VerifyAllocations() function that uses a BufferIntervalTree to check for overlapping Allocations before scheduling the asynchronous copies. This is an extra check for the correctness of MsaAlgorithm allocations, and is only applied if options_.verify is enabled in MSA options. options_.verify is disabled by default. PiperOrigin-RevId: 698164396
PiperOrigin-RevId: 698164750
PiperOrigin-RevId: 698164921
This change adds the legalization pass from IFRT to VIFRT. Legalization uses a templated OpConversion class, which is refined via the `IFRT` <-> `VIFRT` and `mlir::Func::*` <-> `VIFRT` op mappings defined in `map_ifrt_to_vifrt.h` The change versions also `mlir::func::FuncOp`, `mlir::func::ReturnOp` and `mlir::func::CallOp` because this provides the following advantages: 1) we can use the templated OpConversion class rather than implementing a separate converter for each op, and 2) we can restrict the surface of possible breaking changes to just builtin types and attributes. Moreover, the change versions `mlir::FunctionType` and `mlir::TypeAttr` in order to be able to use the generic Op converter, and to restrict types allowed in functions (just builtin and IFRT types). PiperOrigin-RevId: 698168526
Also fixed invalid C++ header usage. PiperOrigin-RevId: 698170878
…td definition. PiperOrigin-RevId: 698171237
PiperOrigin-RevId: 698174417
PiperOrigin-RevId: 698196106
PiperOrigin-RevId: 698201598
PiperOrigin-RevId: 698212499
PiperOrigin-RevId: 698218778
PiperOrigin-RevId: 698221629
PiperOrigin-RevId: 698228306
… Todo(resolved) PiperOrigin-RevId: 698230798
PiperOrigin-RevId: 698230884
PiperOrigin-RevId: 698237370
* De-dupe logic in test common and model_buffer. * Factor out the flatbuffer model wrapper from the class in test common and move to flatbuffer_tools. * Add some extra helpers for flatbuffers in flatbuffer_tools, and add test. * Hide all the usage of `std::filesystem` stuff in one cc. Technically `<filesystem>` is an unapproved header. * Update model_load to use the flatbuffer tools. * Pull some of the member functions of "model unpacker" out into non-member functions. PiperOrigin-RevId: 699249089
…utions Performance is comparable to the synchronous version. Detailed results (where 'old' is the synchronous execution, 'new' is async execution; both use the same, custom algorithm for transposed conv): name old cpu/op new cpu/op delta BM_Conv1DStrided/process_time 29.4ms ± 6% 29.7ms ± 5% ~ (p=0.841 n=5+5) BM_Conv1DTransposedStrided/process_time 29.6ms ± 2% 30.7ms ± 2% +3.52% (p=0.008 n=5+5) BM_Conv1DTransposedStridedNonDefaultLayout/process_time 28.5ms ± 3% 28.3ms ± 1% ~ (p=0.222 n=5+5) name old time/op new time/op delta BM_Conv1DStrided/process_time 2.68ms ± 7% 2.72ms ± 5% ~ (p=0.548 n=5+5) BM_Conv1DTransposedStrided/process_time 7.91ms ± 3% 7.98ms ± 5% ~ (p=0.548 n=5+5) BM_Conv1DTransposedStridedNonDefaultLayout/process_time 7.00ms ± 2% 7.32ms ± 4% +4.58% (p=0.016 n=5+5) PiperOrigin-RevId: 699250549
Updates LLVM usage to match [556ea5265a25](llvm/llvm-project@556ea5265a25) PiperOrigin-RevId: 699251575
NCCL implementation detail will have private visibility, and for all external users (Thunks etc.) we'll export it via public header that uses xla/core/collectives APIs. PiperOrigin-RevId: 699256314
…ator, encoded as follows
```
_TENSOR_V1_<name>: {
TENSOR_SHAPE: Vector<i64>,
TENSOR_TYPE: tflite::TensorType (casted to i64),
TENSOR_DATA: Vector<f32> or Vector<i64>
}
```
PiperOrigin-RevId: 699272982
The pass runs over a VIFRT module, and tries to convert it to a given target version. PiperOrigin-RevId: 699279298
PiperOrigin-RevId: 699279921
PiperOrigin-RevId: 699286343
PiperOrigin-RevId: 699309235
…annot be null PiperOrigin-RevId: 699310290
…ying the naming. PiperOrigin-RevId: 699317601
StreamExecutorGpuClient topology description as well. PiperOrigin-RevId: 699320139
nullptr is handled here. PiperOrigin-RevId: 699323007
Also: * Add some helper functions for checking a litert op matches a tfl op which can can also be re-used in other contexts. * Add some quantization related helper functions to flatbuffer_tools * Update dump for quantization * Move thins around a bit and add quantization stuff to model_util support checks PiperOrigin-RevId: 699333588
PiperOrigin-RevId: 699337598
StreamExecutorGpuTopologyDescription rather than parsing it for every compile. PiperOrigin-RevId: 699344815
… with array output and multiple users. It may trigger compilation error, such as the added test target. PiperOrigin-RevId: 699357851
PiperOrigin-RevId: 699361885
PiperOrigin-RevId: 699397857
PiperOrigin-RevId: 699409569
PiperOrigin-RevId: 699467519
PiperOrigin-RevId: 699496299
PiperOrigin-RevId: 699497695
Reverts c5f0512 PiperOrigin-RevId: 699499360
PiperOrigin-RevId: 699511303
Updates LLVM usage to match [2fe947b47798](llvm/llvm-project@2fe947b47798) PiperOrigin-RevId: 699520196
… Todo (resolved) PiperOrigin-RevId: 699627340
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )